An Online System for Synchronized Processing of Video and Audio Signals

For many audio-visual applications, the integration and synchronization of audio and video signals is essential. The objective of this paper is to develop a system that displays the active objects in the captured video signal, integrated with their respective audio signals in the form of text. The v...

Full description

Saved in:
Bibliographic Details
Main Authors: Mikhail, M., Palumbo, G., Mohammad, J., El-Helaly, M., Amer, A.
Format: Conference Proceeding
Language:English
Subjects:
Application software
audio processing
Clocks
Encoding
Image recognition
Signal processing
signals integration
Speech recognition
Streaming media
Synchronization
synchronized audio and video signals
Text recognition
time-stamping
Timing
Video processing
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:For many audio-visual applications, the integration and synchronization of audio and video signals is essential. The objective of this paper is to develop a system that displays the active objects in the captured video signal, integrated with their respective audio signals in the form of text. The video and audio signals are captured and processed separately. The signals are buffered and integrated and synchronized using a time-stamping technique. Time-stamps provide the timing information for each of the audio and video processes, the speech recognition and the object detection, respectively. This information is necessary to correlate the audio packets to the video frames. Hence, integration is achieved without the use of video information, such as lip movements. The results obtained are based on a specific implementation of the speech recognition module, which is determined to be the bottleneck process in the proposed system
ISSN:0840-7789
2576-7046
DOI:10.1109/CCECE.2006.277564