A Pixel‐Based Framework for Data‐Driven Clothing

We propose a novel approach to learning cloth deformation as a function of body pose, recasting the graph‐like triangle mesh data structure into image‐based data in order to leverage popular and well‐developed convolutional neural networks (CNNs) in a two‐dimensional Euclidean domain. Then, a three‐...

Full description

Saved in:
Bibliographic Details
Published in:Computer graphics forum 2020-12, Vol.39 (8), p.135-144
Main Authors: Jin, N., Zhu, Y., Geng, Z., Fedkiw, R.
Format: Article
Language:English
Subjects:
Animation
Artificial neural networks
CCS Concepts
Cloth
Color imagery
Computer vision representations
Computing methodologies → Animation
Data structures
Deformation
Euclidean geometry
Neural networks
Offsets
Triangles
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:We propose a novel approach to learning cloth deformation as a function of body pose, recasting the graph‐like triangle mesh data structure into image‐based data in order to leverage popular and well‐developed convolutional neural networks (CNNs) in a two‐dimensional Euclidean domain. Then, a three‐dimensional animation of clothing is equivalent to a sequence of two‐dimensional RGB images driven/choreographed by time dependent joint angles. In order to reduce nonlinearity demands on the neural network, we utilize procedural skinning of the body surface to capture much of the rotation/deformation so that the RGB images only contain textures of displacement offsets from skin to clothing. Notably, we illustrate that our approach does not require accurate unclothed body shapes or robust skinning techniques. Additionally, we discuss how standard image based techniques such as image partitioning for higher resolution can readily be incorporated into our framework.
ISSN:0167-7055
1467-8659
DOI:10.1111/cgf.14108