Video Stereolization: Combining Motion Analysis with User Interaction

We present a semiautomatic system that converts conventional videos into stereoscopic videos by combining motion analysis with user interaction, aiming to transfer as much as possible labeling work from the user to the computer. In addition to the widely used structure from motion (SFM) techniques,...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on visualization and computer graphics 2012-07, Vol.18 (7), p.1079-1088
Main Authors: Liao, Miao, Gao, Jizhou, Yang, Ruigang, Gong, Minglun
Format: Article
Language:English
Subjects:
Algorithms
Cameras
Computer Graphics
Depth Perception
Humans
Image segmentation
Image sequences
Imaging, Three-Dimensional - methods
Interactive
Labeling
Marking
Motion
motion analysis
Pixel
Quadratic programming
Semiautomatic 2D-3D conversion
State of the art
stereo/3D video/movie
Stereoscopic
Surveys and Questionnaires
Task Performance and Analysis
Three dimensional
Three dimensional displays
user labeling
User-Computer Interface
Video Recording - methods
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We present a semiautomatic system that converts conventional videos into stereoscopic videos by combining motion analysis with user interaction, aiming to transfer as much as possible labeling work from the user to the computer. In addition to the widely used structure from motion (SFM) techniques, we develop two new methods that analyze the optical flow to provide additional qualitative depth constraints. They remove the camera movement restriction imposed by SFM so that general motions can be used in scene depth estimation-the central problem in mono-to-stereo conversion. With these algorithms, the user's labeling task is significantly simplified. We further developed a quadratic programming approach to incorporate both quantitative depth and qualitative depth (such as these from user scribbling) to recover dense depth maps for all frames, from which stereoscopic view can be synthesized. In addition to visual results, we present user study results showing that our approach is more intuitive and less labor intensive, while producing 3D effect comparable to that from current state-of-the-art interactive algorithms.
ISSN:1077-2626
1941-0506
DOI:10.1109/TVCG.2011.114