Honest signals in video conferencing

We propose a novel system to analyze gestural and nonverbal cues of participants in video conferencing. These cues have previously been referred to as "honest signals" and are usually associated with the underlying cognitive state of the participants. The presented system analyzes a set of...

Full description

Saved in:
Bibliographic Details
Main Authors: Byun, Byungki, Awasthi, Anurag, Chou, Philip A., Kapoor, Ashish, Lee, Bongshin, Czerwinski, Mary
Format: Conference Proceeding
Language:English
Subjects:
Accuracy
Feature extraction
gesture analysis
Hidden Markov models
honest signals
Non-verbal behavior
Real time systems
Servers
Streaming media
video conference
Visualization
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We propose a novel system to analyze gestural and nonverbal cues of participants in video conferencing. These cues have previously been referred to as "honest signals" and are usually associated with the underlying cognitive state of the participants. The presented system analyzes a set of audio-visual, non-linguistic features in real time from the audio and video streams of two participants in a video conference. We show how these features can be used to compute indicators of the overall quality and type of conversation being held. The system also provides visual feedback to the participants, who then have the choice of modifying their conversational style in order to achieve the desired outcome of the video conference. Experiments on real-life data show that the system can predict the type of conversation with high accuracy using the non-linguistic signals only. Qualitative user studies highlight the positive effects of increased awareness amongst the participants about their own gestural and non-verbal cues.
ISSN:1945-7871
1945-788X
DOI:10.1109/ICME.2011.6011855