Assessing the importance of audio/video synchronization for simultaneous translation of video sequences

Lip synchronization is considered a key parameter during interactive communication. In the case of video conferencing and television broadcasting, the differential delay between audio and video should remain below certain thresholds, as recommended by several standardization bodies. However, further...

Full description

Saved in:
Bibliographic Details
Published in:Multimedia systems 2012-11, Vol.18 (6), p.445-457
Main Authors: Staelens, Nicolas, De Meulenaere, Jonas, Bleumers, Lizzy, Van Wallendael, Glenn, De Cock, Jan, Geeraert, Koen, Vercammen, Nick, Van den Broeck, Wendy, Vermeulen, Brecht, Van de Walle, Rik, Demeester, Piet
Format: Article
Language:English
Subjects:
Applied sciences
Broadcasting. Videocommunications. Audiovisual
Computer Communication Networks
Computer Graphics
Computer Science
Cryptology
Data Storage Representation
Exact sciences and technology
Operating Systems
Regular Paper
Telecommunications
Telecommunications and information theory
Television
Videocommunications (networks and services)
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Lip synchronization is considered a key parameter during interactive communication. In the case of video conferencing and television broadcasting, the differential delay between audio and video should remain below certain thresholds, as recommended by several standardization bodies. However, further research has also shown that these thresholds can be relaxed, depending on the targeted application and use case. In this article, we investigate the influence of lip sync on the ability to perform real-time language interpretation during video conferencing. Furthermore, we are also interested in determining proper lip sync visibility thresholds applicable to this use case. Therefore, we conducted a subjective experiment using expert interpreters, which were required to perform a simultaneous translation, and non-experts. Our results show that significant differences are obtained when conducting subjective experiments with expert interpreters. As interpreters are primarily focused on performing the simultaneous translation, lip sync detectability thresholds are higher compared with existing recommended thresholds. As such, primary focus and the targeted application and use case are important factors to be considered when selecting proper lip sync acceptability thresholds.
ISSN:0942-4962
1432-1882
DOI:10.1007/s00530-012-0262-4