Efficient Non-Consecutive Feature Tracking for Robust Structure-From-Motion

Structure-from-motion (SfM) largely relies on feature tracking. In image sequences, if disjointed tracks caused by objects moving in and out of the field of view, occasional occlusion, or image noise are not handled well, corresponding SfM could be affected. This problem becomes severer for large-sc...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on image processing 2016-12, Vol.25 (12), p.5957-5970
Main Authors: Zhang, Guofeng, Liu, Haomin, Dong, Zilong, Jia, Jiaya, Wong, Tien-Tsin, Bao, Hujun
Format: Article
Language:English
Subjects:
bundle adjustment
Cameras
Estimation
Feature extraction
Image segmentation
Non-consecutive feature tracking
structure-from-motion
Three-dimensional displays
track matching
Tracking
Videos
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Structure-from-motion (SfM) largely relies on feature tracking. In image sequences, if disjointed tracks caused by objects moving in and out of the field of view, occasional occlusion, or image noise are not handled well, corresponding SfM could be affected. This problem becomes severer for large-scale scenes, which typically requires to capture multiple sequences to cover the whole scene. In this paper, we propose an efficient non-consecutive feature tracking framework to match interrupted tracks distributed in different subsequences or even in different videos. Our framework consists of steps of solving the feature "dropout" problem when indistinctive structures, noise or large image distortion exists, and of rapidly recognizing and joining common features located in different subsequences. In addition, we contribute an effective segment-based coarse-to-fine SfM algorithm for robustly handling large data sets. Experimental results on challenging video data demonstrate the effectiveness of the proposed system.
ISSN:1057-7149
1941-0042
DOI:10.1109/TIP.2016.2607425