Gaze-corrected view generation using stereo camera system for immersive videoconferencing

In this paper, we present an immersive videoconferencing system that enables gaze correction between users in the internet protocol TV (IPTV) environment. After we capture the object using stereo cameras, we perform preprocessing techniques, such as camera calibration, color correction, and image re...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on consumer electronics 2011-08, Vol.57 (3), p.1033-1040
Main Authors: Lee, Sang-beom, Shin, In-yong, Ho, Yo-sung
Format: Article
Language:English
Subjects:
Calibration
Cameras
Color
Consistency
disparity estimation
Estimation
eye contact
gaze correction
Image color analysis
Immersive videoconferencing
IP (Internet Protocol)
IPTV
Preprocessing
stereo camera system
Teleconferencing
Three dimensional displays
Videoconferencing
viewsynthesis
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In this paper, we present an immersive videoconferencing system that enables gaze correction between users in the internet protocol TV (IPTV) environment. After we capture the object using stereo cameras, we perform preprocessing techniques, such as camera calibration, color correction, and image rectification. The preprocessed images are down-sampled and disparities are computed by using the downsampled images. The disparity sequence is then filtered to improve temporal consistency. After central view synthesis, occlusion areas are decided and holes are filled. The entire system is implemented with parallel programming that is executed on the GPU for realtime processing. Finally, the user can observe the gaze-corrected image through display. From experimental results, we have verified that the proposed stereo camera system is sufficient to generate the natural gaze-corrected virtual image and realize immersive videoconferencing.
ISSN:0098-3063
1558-4127
DOI:10.1109/TCE.2011.6018852