Offset Aperture: A Passive Single-Lens Camera for Depth Sensing

Numerous camera sensors have been recently proposed to estimate the depth of objects in the scene. However, many of these sensors either require multiple imaging elements or an active illuminant. In this paper, we propose a new depth camera, termed offset aperture (OA) camera, which provides depth o...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on circuits and systems for video technology 2019-05, Vol.29 (5), p.1380-1393
Main Authors: Khan, Muhammad Umar Karim, Khan, Asim, Lim, Jinyeon, Hamidov, Said, Choi, Won-Seok, Yun, Woojin, Lee, Yeongmin, Kim, Young-Gyu, Park, Hyun-Sang, Kyung, Chong-Min
Format: Article
Language:English
Subjects:
aperture
Apertures
Applications programs
camera
Cameras
Color imagery
Crosstalk
Depth extraction
Image color analysis
Image quality
Image sensors
Infrared detectors
infrared imaging
Mobile computing
Night vision
Object recognition
Occlusion
Sensors
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Numerous camera sensors have been recently proposed to estimate the depth of objects in the scene. However, many of these sensors either require multiple imaging elements or an active illuminant. In this paper, we propose a new depth camera, termed offset aperture (OA) camera, which provides depth of the scene with a single shot without an active illuminant. The camera is based on a 4-color sensor that senses the infrared (IR) signal along with the visible RGB signals. Separate OAs are used for IR and RGB images. A depth-dependent disparity is generated between the IR and RGB images. There is no disparity across the R, G, and B channel images, which allows the RGB image to be well-aligned. Numerous techniques are used in this work to observe good-quality depth maps and images. Leakage compensation has been proposed to remove crosstalk between the IR and RGB images. A comparison with another 4-color sensor called Dual Aperture camera shows that OA camera provides 88% improvement in depth sensitivity and 45% improvement in color quality, on average. The proposed OA camera can be used for numerous applications including occlusion handling in stereo, selective focus, and night vision. The advantages of the proposed OA camera include competitive image quality, capability of depth extraction, well-aligned RGB images, and small footprint of the camera, which make OA camera a suitable candidate for mobile applications.
ISSN:1051-8215
1558-2205
DOI:10.1109/TCSVT.2018.2840053