Non-line-of-sight reconstruction with signal–object collaborative regularization

• Published in: Light, science & applications science & applications, 2021-09, Vol.10 (1), p.198-198, Article 198
• Main Authors: Liu, Xintong, Wang, Jianyu, Li, Zhupeng, Shi, Zuoqiang, Fu, Xing, Qiu, Lingyun
• Format: Article
• Language: English
• Subjects: 639/624/1107/510; 639/624/400/3925; Albedo; Applied and Technical Physics; Atomic; Classical and Continuum Physics; Collaboration; Lasers; Molecular; Noise; Optical and Plasma Physics; Optical Devices; Optics; Photonics; Physics; Physics and Astronomy; Remote sensing
• ISSN: 2047-7538; 2095-5545; 2047-7538
• DOI: 10.1038/s41377-021-00633-3

Non-line-of-sight imaging aims at recovering obscured objects from multiple scattered lights. It has recently received widespread attention due to its potential applications, such as autonomous driving, rescue operations, and remote sensing. However, in cases with high measurement noise, obtaining high-quality reconstructions remains a challenging task. In this work, we establish a unified regularization framework, which can be tailored for different scenarios, including indoor and outdoor scenes with substantial background noise under both confocal and non-confocal settings. The proposed regularization framework incorporates sparseness and non-local self-similarity of the hidden objects as well as the smoothness of the signals. We show that the estimated signals, albedo, and surface normal of the hidden objects can be reconstructed robustly even with high measurement noise under the proposed framework. Reconstruction results on synthetic and experimental data show that our approach recovers the hidden objects faithfully and outperforms state-of-the-art reconstruction algorithms in terms of both quantitative criteria and visual quality. A Non-line-of-sight reconstruction framework with collaborative regularization of the hidden scene and the signal is proposed to obtain albedo and surface normal of the targets with robustness to noise.