Low-latency time-of-flight non-line-of-sight imaging at 5 frames per second

Non-Line-Of-Sight (NLOS) imaging aims at recovering the 3D geometry of objects that are hidden from the direct line of sight. One major challenge with this technique is the weak available multibounce signal limiting scene size, capture speed, and reconstruction quality. To overcome this obstacle, we...

Full description

Saved in:
Bibliographic Details
Published in:Nature communications 2021-11, Vol.12 (1), p.6526-6526, Article 6526
Main Authors: Nam, Ji Hyun, Brandt, Eric, Bauer, Sebastian, Liu, Xiaochun, Renna, Marco, Tosi, Alberto, Sifakis, Eftychios, Velten, Andreas
Format: Article
Language:English
Subjects:
639/624/1075
639/624/1107/510
639/766/930/2735
Algorithms
Angular resolution
Arrays
Avalanche diodes
Blurring
Detectors
Frames per second
Humanities and Social Sciences
Image reconstruction
Lasers
Latency
Light
Line of sight
Methods
Motion detection
multidisciplinary
Noise
Photon avalanches
Science
Science (multidisciplinary)
Sensors
Signal to noise ratio
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Non-Line-Of-Sight (NLOS) imaging aims at recovering the 3D geometry of objects that are hidden from the direct line of sight. One major challenge with this technique is the weak available multibounce signal limiting scene size, capture speed, and reconstruction quality. To overcome this obstacle, we introduce a multipixel time-of-flight non-line-of-sight imaging method combining specifically designed Single Photon Avalanche Diode (SPAD) array detectors with a fast reconstruction algorithm that captures and reconstructs live low-latency videos of non-line-of-sight scenes with natural non-retroreflective objects. We develop a model of the signal-to-noise-ratio of non-line-of-sight imaging and use it to devise a method that reconstructs the scene such that signal-to-noise-ratio, motion blur, angular resolution, and depth resolution are all independent of scene depth suggesting that reconstruction of very large scenes may be possible. Non-line-of-sight imaging can recover the 3D geometry of hidden objects, but is limited by weak multibounce signals. Here, the authors introduce a multipixel time-of-flight NLOS imaging approach, combining array detectors and a fast algorithm, for live reconstruction of natural nonretroreflective objects.
ISSN:2041-1723
2041-1723
DOI:10.1038/s41467-021-26721-x