Online Camera-LiDAR Calibration Monitoring and Rotational Drift Tracking

• Published in: IEEE transactions on robotics 2024-01, Vol.40, p.1-20
• Main Authors: Moravec, Jaroslav, Sara, Radim
• Format: Article
• Language: English
• Subjects: Accuracy; Calibration; Calibration and Identification; Cameras; Computer Vision for Transportation; Drift; Feature extraction; Laser radar; Lidar; LiDAR-Camera Systems; Monitoring; Parameters; Sensor Fusion; Sensor systems; Three-dimensional displays; Tracking; Visual perception; Yaw
• ISSN: 1552-3098; 1941-0468
• DOI: 10.1109/TRO.2023.3347130

The relative poses of visual perception sensors distributed over a vehicle's body may vary due to dynamic forces, thermal dilations, or minor accidents. This paper proposes two methods, OCAMO and LTO, that monitor and track the LiDAR-Camera extrinsic calibration parameters online. Calibration monitoring provides a certificate for reference calibration parameters validity. Tracking follows the calibration parameters drift in time. OCAMO is based on an adaptive online stochastic optimization with a memory of past evolution. LTO uses a fixed-grid search for the optimal parameters per frame and without memory. Both methods use low-level point-like features, a robust kernel-based loss function, and work with a small memory footprint and computational overhead. Both include a preselection of informative data that limits their divergence. The statistical accuracy of both calibration monitoring methods is over 98%, whereas OCAMO monitoring can detect small decalibrations better, and LTO monitoring reacts faster on abrupt decalibrations. The tracking variants of both methods follow random calibration drift with an accuracy of about 0.03° in the yaw angle.