Depth-Based Texture Coding in AVC-Compatible 3D Video Coding

• Published in: IEEE transactions on circuits and systems for video technology 2015-08, Vol.25 (8), p.1347-1361
• Main Authors: Jin Young Lee, Jian-Liang Lin, Yi-Wen Chen, Yu-Lin Chang, Kovliga, Igor, Fartukov, Alexey, Mishurovskiy, Mikhail, Ho-Cheon Wey, Yu-Wen Huang, Shaw-Min Lei
• Format: Article
• Language: English
• Subjects: adaptive luminance compensation (ALC); AVC-compatible 3D video coding (3D-AVC); block-based view synthesis prediction (BVSP); Cameras; Decoding; depth-based motion vector prediction (DMVP); Encoding; Image coding; Three-dimensional displays; Vectors; Video coding
• ISSN: 1051-8215; 1558-2205
• DOI: 10.1109/TCSVT.2014.2380191

The target of 3D video coding is to compress Multiview Video plus Depth (MVD) format data, which consist of a texture image and its corresponding depth map. In the MVD format, the depth map plays an important role for successful services in 3D video applications, because it enables the user to experience 3D by generating arbitrary intermediate views. The depth map has a strong correlation with its associated texture data, so it can be utilized to improve texture coding efficiency. This paper introduces a novel and efficient depth-based texture coding scheme. It includes depth-based motion vector prediction, block-based view synthesis prediction, and adaptive luminance compensation, which were adopted in an AVC-compatible 3D video coding standard. Simulation results demonstrate that the proposed scheme reduces the total coding bitrates of texture and depth by 19.06% for the coded PSNR and 17.01% for the synthesized PSNR in a P-I-P view prediction structure, respectively.