Performance analysis of single-query 6-DoF camera pose estimation in self-driving setups

• Published in: Computer vision and image understanding 2019-09, Vol.186, p.58-73
• Main Authors: Fu, Junsheng, Pertuz, Said, Matas, Jiri, Kämäräinen, Joni-Kristian
• Format: Article
• Language: English
• Subjects: 3D point cloud; Camera pose estimation; Hybrid method; Mutual information; Photometric matching; Self driving car
• ISSN: 1077-3142; 1090-235X
• DOI: 10.1016/j.cviu.2019.04.009

In this work, we consider the problem of single-query 6-DoF camera pose estimation, i.e. estimating the position and orientation of a camera by using reference images and a point cloud. We perform a systematic comparison of three state-of-the-art strategies for 6-DoF camera pose estimation: feature-based, photometric-based and mutual-information-based approaches. Two standard datasets with self-driving setups are used for experiments, and the performance of the studied methods is evaluated in terms of success rate, translation error and maximum orientation error. Building on the analysis of the results, we evaluate a hybrid approach that combines feature-based and mutual-information-based pose estimation methods to benefit from their complementary properties for pose estimation. Experiments show that (1) in cases with large appearance change between query and reference, the hybrid approach outperforms feature-based and mutual-information-based approaches by an average increment of 9.4% and 8.7% in the success rate, respectively; (2) in cases where query and reference images are captured at similar imaging conditions, the hybrid approach performs similarly as the feature-based approach, but outperforms both photometric-based and mutual-information-based approaches with a clear margin; (3) the feature-based approach is consistently more accurate than mutual-information-based and photometric-based approaches when at least 4 consistent matching points are found between the query and reference images. •Systematic comparison of 3 strategies of single-query 6-DoF camera pose estimation.•Feature-based pose estimation is the most accurate method.•Mutual-information-based pose estimation is the most robust method.•Feature-based and mutual-information-based methods can be combined as a hybrid method.•The hybrid approach is on par or superior to single approaches.