Coupled Structure-from-Motion and 3D Symmetry Detection for Urban Facades

Repeated structures are ubiquitous in urban facades. Such repetitions lead to ambiguity in establishing correspondences across sets of unordered images. A decoupled structure-from-motion reconstruction followed by symmetry detection often produces errors: outputs are either noisy and incomplete, or...

Full description

Saved in:
Bibliographic Details
Published in:ACM transactions on graphics 2014, Vol.33 (1), p.1-15
Main Authors: CEYLAN, Duygu, MITRA, Niloy J, YOUYI ZHENG, PAULY, Mark
Format: Article
Language:English
Subjects:
Applied sciences
Artificial intelligence
Calibration
Computer science
control theory
systems
Consistency
Exact sciences and technology
Facades
Pattern recognition. Digital image processing. Computational geometry
Repetition
Robustness
Symmetry detection
Three dimensional
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Repeated structures are ubiquitous in urban facades. Such repetitions lead to ambiguity in establishing correspondences across sets of unordered images. A decoupled structure-from-motion reconstruction followed by symmetry detection often produces errors: outputs are either noisy and incomplete, or even worse, appear to be valid but actually have a wrong number of repeated elements. We present an optimization framework for extracting repeated elements in images of urban facades, while simultaneously calibrating the input images and recovering the 3D scene geometry using a graph-based global analysis. We evaluate the robustness of the proposed scheme on a range of challenging examples containing widespread repetitions and nondistinctive features. These image sets are common but cannot be handled well with state-of-the-art methods. We show that the recovered symmetry information along with the 3D geometry enables a range of novel image editing operations that maintain consistency across the images.
ISSN:0730-0301
1557-7368
DOI:10.1145/2517348