Coding Distortion Elimination of Virtual View Synthesis for 3D Video System: Theoretical Analyses and Implementation

• Published in: IEEE transactions on broadcasting 2012-12, Vol.58 (4), p.558-568
• Main Authors: Yuan, Hui, Liu, Ju, Xu, Hongji, Li, Zhibin, Liu, Wei
• Format: Article
• Language: English
• Subjects: 3DV; Applied sciences; Detection, estimation, filtering, equalization, prediction; Encoding; Exact sciences and technology; Image processing; Information, signal and communications theory; Noise measurement; Signal and communications theory; Signal processing; Signal representation. Spectral analysis; Signal, noise; Systems, networks and services of telecommunications; Telecommunications; Telecommunications and information theory; Three dimensional displays; Transform coding; Transmission and modulation (techniques and equipments); video coding; virtual view synthesis; Virtualization; Wiener filter
• ISSN: 0018-9316; 1557-9611
• DOI: 10.1109/TBC.2012.2187612

For a three dimensional video (3DV) system, coding distortion of texture videos and depth maps could be propagated to virtual views during the view synthesis procedure. In this paper, the coding distortion is considered in the virtual view synthesis. In order to reduce the coding distortion as well as improve the qualities of synthesized virtual views, Wiener filter is utilized in 3DV systems. To ensure that Wiener filter could be implemented on virtual views, the principles of virtual view synthesis and Wiener filter are presented and analyzed in detail. Subsequently, the implementation of Wiener filter is designed for 3DV system. In the proposed method, Wiener filter coefficients of each frame are calculated in the 3DV server, and then transmitted to the 3DV terminal. By employing those Wiener filter coefficients, post filtering on the virtual views could be implemented after the virtual view synthesis procedure. Experimental results demonstrate that a maximum 0.742 dB PSNR gain could be achieved when comparing the proposed method (taking the coding bits of depth maps, texture videos, and that of Wiener filter coefficients into consideration) with the virtual view synthesis method without Wiener filter at the same coding bit rate of a 3DV system.