EpiLoc: Deep Camera Localization Under Epipolar Constraint

Recent works have shown that the geometric constraint can be harnessed to boost the performance of CNN-based camera localization. However, the existing strategies are limited to imposing image-level constraint between pose pairs, which is weak and coarse-gained. In this paper, we introduce a pixel-l...

Full description

Saved in:
Bibliographic Details
Published in:KSII transactions on Internet and information systems 2022, 16(6), , pp.2044-2059
Main Authors: Xu, Luoyuan, Guan, Tao, Luo, Yawei, Wang, Yuesong, Chen, Zhuo, Liu, WenKai
Format: Article
Language:eng ; kor
Subjects:
Camera localization
End-to-end
Epipolar geometry
Pixel-level constraint
컴퓨터학
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Recent works have shown that the geometric constraint can be harnessed to boost the performance of CNN-based camera localization. However, the existing strategies are limited to imposing image-level constraint between pose pairs, which is weak and coarse-gained. In this paper, we introduce a pixel-level epipolar geometry constraint to vanilla localization framework without the ground-truth 3D information. Dubbed EpiLoc, our method establishes the geometric relationship between pixels in different images by utilizing the epipolar geometry thus forcing the network to regress more accurate poses. We also propose a variant called EpiSingle to cope with non-sequential training images, which can construct the epipolar geometry constraint based on a single image in a self-supervised manner. Extensive experiments on the public indoor 7Scenes and outdoor RobotCar datasets show that the proposed pixel-level constraint is valuable, and helps our EpiLoc achieve state-of-the-art results in the end-to-end camera localization task.
ISSN:1976-7277
1976-7277
DOI:10.3837/tiis.2022.06.014