TutteNet: Injective 3D Deformations by Composition of 2D Mesh Deformations

This work proposes a novel representation of injective deformations of 3D space, which overcomes existing limi-tations of injective methods, namely inaccuracy, lack of ro-bustness, and incompatibility with general learning and op-timization frameworks. Our core idea is to reduce the prob-lem to a &q...

Full description

Saved in:
Bibliographic Details
Main Authors: Sun, Bo, Groueix, Thibault, Song, Chen, Huang, Qixing, Aigerman, Noam
Format: Conference Proceeding
Language:English
Subjects:
3D Deformation
Bijective Mapping
Computer vision
Deformation
NeRF
Neural radiance field
Real-time systems
Rendering (computer graphics)
Shape
Three-dimensional displays
Tutte Embedding
Online Access:Request full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:This work proposes a novel representation of injective deformations of 3D space, which overcomes existing limi-tations of injective methods, namely inaccuracy, lack of ro-bustness, and incompatibility with general learning and op-timization frameworks. Our core idea is to reduce the prob-lem to a "deep" composition of multiple 2D mesh-based piecewise-linear maps. Namely, we build differentiable lay-ers that produce mesh deformations through Tutte's embed-ding (guaranteed to be injective in 2D), and compose these layers over different planes to create complex 3D injective deformations of the 3D volume. We show our method pro-vides the ability to efficiently and accurately optimize and learn complex deformations, outperforming other injective approaches. As a main application, we produce complex and artifact-free NeRF and SDF deformations.
ISSN:2575-7075
DOI:10.1109/CVPR52733.2024.02020