Depth compression via planar segmentation

• Published in: Multimedia tools and applications 2019-03, Vol.78 (6), p.6529-6558
• Main Authors: Kumar, S. Hemanth, K. R. Ramakrishnan
• Format: Article
• Language: English
• Subjects: Augmented reality; Codec; Coding; Coding standards; Computer Communication Networks; Computer Science; Data Structures and Information Theory; Electronic devices; Image segmentation; Markov processes; Multimedia Information Systems; Sensors; Smartphones; Special Purpose and Application-Based Systems; Video compression
• ISSN: 1380-7501; 1573-7721
• DOI: 10.1007/s11042-018-6327-4

Augmented Reality applications are set to revolutionize the smartphone industry due to the integration of RGB-D sensors into mobile devices. Given the large number of smartphone users, efficient storage and transmission of RGB-D data is of paramount interest to the research community. While there exist Video Coding Standards such as HEVC and H.264/AVC for compression of RGB/texture component, the coding of depth data is still an area of active research. This paper presents a method for coding depth videos, captured from mobile RGB-D sensors, by planar segmentation. The segmentation algorithm is based on Markov Random Field assumptions on depth data and solved using Graph Cuts. While all prior works based on this approach remain restricted to images only and under noise-free conditions, this paper presents an efficient solution to planar segmentation in noisy depth videos. Also presented is a unique method to encode depth based on its segmented planar representation. Experiments on depth captured from a noisy sensor (Microsoft Kinect) shows superior Rate-Distortion performance over the 3D extension of HEVC codec.