Precise depth map upsampling and enhancement based on edge-preserving fusion filters

• Published in: IET computer vision 2018-08, Vol.12 (5), p.651-658
• Main Authors: Chang, Ting-An, Yang, Jar-Ferr
• Format: Article
• Language: English
• Subjects: adaptive filters; adaptive gradient fusion filters; depth capture devices; depth map enhancement system; edge-preserving fusion filters; image denoising; image enhancement; image filtering; image fusion; image representation; image restoration; image sampling; image texture; interpolation; low-resolution depth map; noise removal; noise suppression; potency guided upsampling; precise depth map enhancement; precise depth map upsampling; Research Article; texture image; three-dimensional image representation; video coding; video signals
• ISSN: 1751-9632; 1751-9640; 1751-9640
• DOI: 10.1049/iet-cvi.2017.0336

A texture image plus its associated depth map is the simplest representation of a three-dimensional image and video signals and can be further encoded for effective transmission. Since it contains fewer variations, a depth map can be coded with much lower resolution than a texture image. Furthermore, the resolution of depth capture devices is usually also lower. Thus, a low-resolution depth map with possible noise requires appropriate interpolation to restore it to full resolution and remove noise. In this study, the authors propose potency guided upsampling and adaptive gradient fusion filters to enhance the erroneous depth maps. The proposed depth map enhancement system can successfully suppress noise, fill missing values, sharpen foreground objects, and smooth background regions simultaneously. Their experimental results show that the proposed methods perform better in terms of both visual and subjective metrics than the classic methods and achieve results that are visually comparable with those of some time-consuming methods.