Hemiface mirroring: a new approach to reducing bandwidth requirements of audiovisual telecommunication

Research has shown that the sight of a speaker's face can dramatically improve the intelligibility of speech. The addition of a video stream to telecommunications systems is, therefore, a highly desirable goal. Extending the content-based coding paradigm of MPEG-4, we present a novel method of...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on circuits and systems for video technology 2002-02, Vol.12 (2), p.130-135
Main Authors: Monteiro, A., Jordan, T.R.
Format: Article
Language:English
Subjects:
Applied sciences
Audiovisual
Bandwidth
Circuits
Copper
Exact sciences and technology
Human
Image processing
Information, signal and communications theory
Intelligibility
ISDN
MPEG 4 Standard
Perception
Signal processing
Signal to noise ratio
Speech
Speech synthesis
Streaming media
Telecommunication services
Telecommunications
Telecommunications and information theory
Teleconferencing
Telephony
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Research has shown that the sight of a speaker's face can dramatically improve the intelligibility of speech. The addition of a video stream to telecommunications systems is, therefore, a highly desirable goal. Extending the content-based coding paradigm of MPEG-4, we present a novel method of reducing the amount of data required to represent video images of human speakers. This method is based around the mirroring of vertical halves of the speaker's face. We report an experiment that compared video of synthesized speaking faces (constructed by mirroring hemifaces) with that of "normal" (un-manipulated) speaking faces. The results of the experiment show that the synthesized faces provided the same benefits to speech perception as the normal faces. Development of this technique as an image-coding technique for audiovisual telecommunication applications is discussed.
ISSN:1051-8215
1558-2205
DOI:10.1109/76.988660