Self-Supervised Learning of Depth and Pose Using Cycle Generative Adversarial Network

In recent years, large amount of ground truth data is typically required to feed into the supervised depth estimation models to produce satisfactory performance, while it is usually costly and impracticable to acquire depth ground truth. In this paper, we propose a self-supervised joint deep learnin...

Full description

Saved in:
Bibliographic Details
Main Authors: Tong, Yunhe, Wang, Anjie, Tan, Songchao, Wang, Shanshe, Ma, Siwei, Gao, Wen
Format: Conference Proceeding
Language:English
Subjects:
CycleGAN
depth estimation
Indexes
monocular
pose estimation
Self-supervised learning
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:In recent years, large amount of ground truth data is typically required to feed into the supervised depth estimation models to produce satisfactory performance, while it is usually costly and impracticable to acquire depth ground truth. In this paper, we propose a self-supervised joint deep learning pipeline for depth and pose estimation of monocular video sequences, which uses the cycle generation adversarial network structure to extend the existing reconstruction loss function based on photometric consistency. The generation function of the algorithm learns to synthesize the adjacent image to predict the depth map and the relative target pose, and the discriminant function learns the dispersion of the monocular images to correctly classify the realism of the composite image. At the same time, a reconstruction loss function based on pose consistency is used to assist the generator function in training. Extensive experimental results on the KITTI dataset show superior performance of the proposed method.
ISSN:2381-8549
DOI:10.1109/ICIP40778.2020.9191124