Large Field of View Cooperative Infrared and Visible Spectral Sensor for Visual Odometry

Thermal images produced by the long-wavelength infrared (LWIR) camera are robust and independent from environmental illumination change. They can help the standard visible light camera working under the complicated environmental condition. Breaking through the traditional stereo multi-spectral senso...

Full description

Saved in:
Bibliographic Details
Published in:IEEE access 2020, Vol.8, p.74237-74249
Main Authors: Ni, Yubo, Wang, Yue, Yang, Shouchang, Chen, Ruixiang, Wang, Xiangjun
Format: Article
Language:English
Subjects:
Calibration
Cameras
direct method
Embedded systems
Feature extraction
Field of view
Horizontal distribution
Infrared
Infrared cameras
Infrared detectors
Infrared imagery
Laser radar
Microprocessors
Optimization
Power consumption
Robot sensing systems
Sensors
Spectra
stereo vision
Three-dimensional displays
visible
visual odometer
Visualization
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Thermal images produced by the long-wavelength infrared (LWIR) camera are robust and independent from environmental illumination change. They can help the standard visible light camera working under the complicated environmental condition. Breaking through the traditional stereo multi-spectral sensor consisting of a visible-light camera and a LWIR camera, a novel architecture of large field of view (FOV) cooperated infrared and visible spectral sensor for visual odometry is proposed. The novel sensor is equipped with two visible cameras, four infrared cameras covering 120 degrees FOV in horizontal under both bands. Distribution of cameras and related peripheral devices are specifically designed which makes the sensor's volume less than 100 cm (length) \times10 cm (height) \times10 cm (width). The sensor's cameras calibration, distortion correction and measurement principle are elaborated. Feature-based method for visible and multi-windowed optimization-based image alignment for infrared is designed for the visual odometer based on the different imaging mechanism and distribution of cameras in the sensor. The frames and estimated poses management from both bands are proposed. Moreover, all proposed methodologies can be implemented in the sensor's embedded processor. The electrical power consumption is only 12W. Experiments of the sensor's evaluation are performed, experimental results show that large FOV cooperated multi-spectral cameras can efficiently improve the robustness of visual odometry. The real-time performance of the sensor is higher than 10fps with disparity map construction under both bands.
ISSN:2169-3536
2169-3536
DOI:10.1109/ACCESS.2020.2988664