Interactive High-Relief Reconstruction for Organic and Double-Sided Objects from a Photo

We introduce an interactive user-driven method to reconstruct high-relief 3D geometry from a single photo. Particularly, we consider two novel but challenging reconstruction issues: i) common non-rigid objects whose shapes are organic rather than polyhedral/symmetric, and ii) double-sided structures...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on visualization and computer graphics 2017-07, Vol.23 (7), p.1796-1808
Main Authors: Chih-Kuo Yeh, Shi-Yang Huang, Jayaraman, Pradeep Kumar, Chi-Wing Fu, Tong-Yee Lee
Format: Article
Language:English
Subjects:
Angles (geometry)
completion
Curvature
depth cues
double-sided
Flowers
folded
Geometry
high-relief
Image reconstruction
Image segmentation
inflation
lenticular posters
object modeling
Occlusion
Reconstruction
Shape
single image
Solid modeling
Surface reconstruction
Three dimensional models
Three-dimensional displays
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We introduce an interactive user-driven method to reconstruct high-relief 3D geometry from a single photo. Particularly, we consider two novel but challenging reconstruction issues: i) common non-rigid objects whose shapes are organic rather than polyhedral/symmetric, and ii) double-sided structures, where front and back sides of some curvy object parts are revealed simultaneously on image. To address these issues, we develop a three-stage computational pipeline. First, we construct a 2.5D model from the input image by user-driven segmentation, automatic layering, and region completion, handling three common types of occlusion. Second, users can interactively mark-up slope and curvature cues on the image to guide our constrained optimization model to inflate and lift up the image layers. We provide real-time preview of the inflated geometry to allow interactive editing. Third, we stitch and optimize the inflated layers to produce a high-relief 3D model. Compared to previous work, we can generate high-relief geometry with large viewing angles, handle complex organic objects with multiple occluded regions and varying shape profiles, and reconstruct objects with double-sided structures. Lastly, we demonstrate the applicability of our method on a wide variety of input images with human, animals, flowers, etc.
ISSN:1077-2626
1941-0506
DOI:10.1109/TVCG.2016.2574705