Towards 3-D scene reconstruction from broadcast video

• Published in: Signal processing. Image communication 2007-02, Vol.22 (2), p.108-126
• Main Authors: İmre, Evren, Knorr, Sebastian, Özkalaycı, Burak, Topay, Uğur, Aydın Alatan, A., Sikora, Thomas
• Format: Article
• Language: English
• Subjects: 3-D TV; Dense 3-D reconstruction; Feature segmentation; Feature tracking; Structure from motion
• ISSN: 0923-5965; 1879-2677
• DOI: 10.1016/j.image.2006.11.011

Three-dimensional (3-D) scene reconstruction from broadcast video is a challenging problem with many potential applications, such as 3-D TV, free-view TV, augmented reality or three-dimensionalization of two-dimensional (2-D) media archives. In this paper, a flexible and effective system capable of efficiently reconstructing 3-D scenes from broadcast video is proposed, with the assumption that there is relative motion between camera and scene/objects. The system requires no a priori information and input, other than the video sequence itself, and capable of estimating the internal and external camera parameters and performing a 3-D motion-based segmentation, as well as computing a dense depth field. The system also serves as a showcase to present some novel approaches for moving object segmentation, sparse and dense reconstruction problems. According to the simulations for both synthetic and real data, the system achieves a promising performance for typical TV content, indicating that it is a significant step towards the 3-D reconstruction of scenes from broadcast video.