The Voice of Leadership: Models and Performances of Automatic Analysis in Online Speeches

We introduce the automatic determination of leadership emergence by acoustic and linguistic features in online speeches. Full realism is provided by the varying and challenging acoustic conditions of the presented YouTube corpus of online available speeches labeled by 10 raters and by processing tha...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on affective computing 2012, Vol.3 (4), p.496-508
Main Authors: Weninger, F., Krajewski, J., Batliner, A., Schuller, B.
Format: Article
Language:English
Subjects:
acoustic/linguistic fusion
Acoustics
dimensional analysis
Ethics
Linguistics
Personality analysis
Pragmatics
Speech recognition
Training
YouTube
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We introduce the automatic determination of leadership emergence by acoustic and linguistic features in online speeches. Full realism is provided by the varying and challenging acoustic conditions of the presented YouTube corpus of online available speeches labeled by 10 raters and by processing that includes Long Short-Term Memory-based robust voice activity detection (VAD) and automatic speech recognition (ASR) prior to feature extraction. We discuss cluster-preserving scaling of 10 original dimensions for discrete and continuous task modeling, ground truth establishment, and appropriate feature extraction for this novel speaker trait analysis paradigm. In extensive classification and regression runs, different temporal chunkings and optimal late fusion strategies (LFSs) of feature streams are presented. In the result, achievers, charismatic speakers, and teamplayers can be recognized significantly above chance level, reaching up to 72.5 percent accuracy on unseen test data.
ISSN:1949-3045
1949-3045
DOI:10.1109/T-AFFC.2012.15