Nautilus: recovering regional symmetry transformations for image editing

Natural images often exhibit symmetries that should be taken into account when editing them. In this paper we present Nautilus --- a method for automatically identifying symmetric regions in an image along with their corresponding symmetry transformations. We compute dense local similarity symmetry...

Full description

Saved in:
Bibliographic Details
Published in:ACM transactions on graphics 2017-08, Vol.36 (4), p.1-11
Main Authors: Lukáč, Michal, Sýkora, Daniel, Sunkavalli, Kalyan, Shechtman, Eli, Jamriška, Ondřej, Carr, Nathan, Pajdla, Tomáš
Format: Article
Language:English
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Natural images often exhibit symmetries that should be taken into account when editing them. In this paper we present Nautilus --- a method for automatically identifying symmetric regions in an image along with their corresponding symmetry transformations. We compute dense local similarity symmetry transformations using a novel variant of the Generalised PatchMatch algorithm that uses Metropolis-Hastings sampling. We combine and refine these local symmetries using an extended Lucas-Kanade algorithm to compute regional transformations and their spatial extents. Our approach produces dense estimates of complex symmetries that are combinations of translation, rotation, scale, and reflection under perspective distortion. This enables a number of automatic symmetry-aware image editing applications including inpainting, rectification, beautification, and segmentation, and we demonstrate state-of-the-art applications for each of them.
ISSN:0730-0301
1557-7368
DOI:10.1145/3072959.3073661