DetailGen3D: Generative 3D Geometry Enhancement via Data-Dependent Flow

Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to enhance these generated 3D shapes. Our key insight is to model th...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2024-11
Main Authors: Deng, Ken, Guo, Yuanchen, Sun, Jingxiang, Zou, Zixin, Li, Yangguang, Cai, Xin, Cao, Yanpei, Liu, Yebin, Ding, Liang
Format: Article
Language:English
Subjects:
Spatial data
Synthesis
Three dimensional flow
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Modern 3D generation methods can rapidly create shapes from sparse or single views, but their outputs often lack geometric detail due to computational constraints. We present DetailGen3D, a generative approach specifically designed to enhance these generated 3D shapes. Our key insight is to model the coarse-to-fine transformation directly through data-dependent flows in latent space, avoiding the computational overhead of large-scale 3D generative models. We introduce a token matching strategy that ensures accurate spatial correspondence during refinement, enabling local detail synthesis while preserving global structure. By carefully designing our training data to match the characteristics of synthesized coarse shapes, our method can effectively enhance shapes produced by various 3D generation and reconstruction approaches, from single-view to sparse multi-view inputs. Extensive experiments demonstrate that DetailGen3D achieves high-fidelity geometric detail synthesis while maintaining efficiency in training.
ISSN:2331-8422