Colored 3D surface reconstruction using Kinect sensor

• Published in: Optoelectronics letters 2015-03, Vol.11 (2), p.153-156
• Main Author: 郭连朋 陈向宁 陈颖 刘彬
• Format: Article
• Language: English
• Subjects: Lasers; Optical Devices; Optics; Photonics; Physics; Physics and Astronomy; 三维表面重建; 传感器; 区域分割; 图像处理; 峰值信噪比; 彩色图像; 滤波器; 重建方法
• ISSN: 1673-1905; 1993-5013
• DOI: 10.1007/s11801-015-5013-2

A colored 3D surface reconstruction method which effectively fuses the information of both depth and color image using Microsoft Kinect is proposed and demonstrated by experiment. Kinect depth images are processed with the im- proved joint-bilateral filter based on region segmentation which efficiently combines the depth and color data to im- prove its quality. The registered depth data are integrated to achieve a surface reconstruction through the colored trun- cated signed distance fields presented in this paper. Finally, the improved ray casting for rendering full colored surface is implemented to estimate color texture of the reconstruction object. Capturing the depth and color images of a toy car, the improved joint-bilateral filter based on region segmentation is used to improve the quality of depth images and the peak signal-to-noise ratio （PSNR） is approximately 4.57 dB, which is better than 1.16 dB of the joint-bilateral filter. The colored construction results of toy car demonstrate the suitability and ability of the proposed method.