Let Your Body Speak: Communicative Cue Extraction on Natural Interaction Using RGBD Data

Employment interviews are relevant scenarios for the study of social interaction. In this setting, social skills play an important role, even though the interactions between potential employers and candidates are often limited. One fundamental aspect of social interaction is the use of nonverbal com...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on multimedia 2015-10, Vol.17 (10), p.1721-1732
Main Authors: Marcos-Ramiro, Alvaro, Pizarro, Daniel, Marron-Romera, Marta, Gatica-Perez, Daniel
Format: Article
Language:English
Subjects:
Cameras
Face
Feature extraction
Image color analysis
Image segmentation
Markerless motion capture
nonverbal cues
rgb-d fusion
Sensors
social interaction
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Employment interviews are relevant scenarios for the study of social interaction. In this setting, social skills play an important role, even though the interactions between potential employers and candidates are often limited. One fundamental aspect of social interaction is the use of nonverbal communication , which affects how we are socially perceived. We present a method to automatically extract body communicative cues from one-on-one conversations recorded with Kinect devices. First, we find the three-dimensional position of hands and head of the subject, and, aided by training data, we infer the upper body pose. Then, we use the inferred poses to perform action recognition and build person-specific activity descriptors. We evaluate our system with both domain-specific and public, generic datasets, and show competitive performance.
ISSN:1520-9210
1941-0077
DOI:10.1109/TMM.2015.2464152