The gesturer is the speaker

We present and solve the speaker diarization problem in a novel way. We hypothesize that the gesturer is the speaker and that identifying the gesturer can be taken as identifying the active speaker. We provide evidence in support of the hypothesis from gesture literature and audio-visual synchrony s...

Full description

Saved in:
Bibliographic Details
Main Authors: Gebre, Binyam Gebrekidan, Wittenburg, Peter, Heskes, Tom
Format: Conference Proceeding
Language:English
Subjects:
Abstracts
Gesturer diarisation
Speaker diarisation
Speaker segmentation
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present and solve the speaker diarization problem in a novel way. We hypothesize that the gesturer is the speaker and that identifying the gesturer can be taken as identifying the active speaker. We provide evidence in support of the hypothesis from gesture literature and audio-visual synchrony studies. We also present a vision-only diarization algorithm that relies on gestures (i.e. upper body movements). Experiments carried out on 8.9 hours of a publicly available dataset (the AMI meeting data) show that diarization error rates as low as 15% can be achieved.
ISSN:1520-6149
2379-190X
DOI:10.1109/ICASSP.2013.6638359