Self-Supervised Monocular Depth Estimation via Binocular Geometric Correlation Learning

• Published in: ACM transactions on multimedia computing communications and applications 2024-08, Vol.20 (8), p.1-19, Article 250
• Main Authors: Peng, Bo, Sun, Lin, Lei, Jianjun, Liu, Bingzheng, Shen, Haifeng, Li, Wanqing, Huang, Qingming
• Format: Article
• Language: English
• Subjects: Information systems; Multimedia information systems
• ISSN: 1551-6857; 1551-6865
• DOI: 10.1145/3663570

Monocular depth estimation aims to infer a depth map from a single image. Although supervised learning-based methods have achieved remarkable performance, they generally rely on a large amount of labor-intensively annotated data. Self-supervised methods, on the other hand, do not require any annotation of ground-truth depth and have recently attracted increasing attention. In this work, we propose a self-supervised monocular depth estimation network via binocular geometric correlation learning. Specifically, considering the inter-view geometric correlation, a binocular cue prediction module is presented to generate the auxiliary vision cue for the self-supervised learning of monocular depth estimation. Then, to deal with the occlusion in depth estimation, an occlusion interference attenuated constraint is developed to guide the supervision of the network by inferring the occlusion region and producing paired occlusion masks. Experimental results on two popular benchmark datasets have demonstrated that the proposed network obtains competitive results compared to state-of-the-art self-supervised methods and achieves comparable results to some popular supervised methods.