An Integrated Platform for Live 3D Human Reconstruction and Motion Capturing

The latest developments in 3D capturing, processing, and rendering provide means to unlock novel 3D application pathways. The main elements of an integrated platform, which target tele-immersion and future 3D applications, are described in this paper, addressing the tasks of real-time capturing, rob...

Full description

Saved in:
Bibliographic Details
Published in:IEEE transactions on circuits and systems for video technology 2017-04, Vol.27 (4), p.798-813
Main Authors: Alexiadis, Dimitrios S., Chatzitofis, Anargyros, Zioulis, Nikolaos, Zoidi, Olga, Louizis, Georgios, Zarpalas, Dimitrios, Daras, Petros
Format: Article
Language:English
Subjects:
3D motion capture
3D reconstruction
Calibration
depth sensors
evaluation
Fourier transforms
Human motion
Image reconstruction
Kinect
Mapping
Parallel processing
Quantitative analysis
Real time
Real-time systems
Sensors
Skeleton
skeleton tracking
Submerging
tele-immersion (TI)
Three dimensional motion
Three-dimensional displays
Tracking
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The latest developments in 3D capturing, processing, and rendering provide means to unlock novel 3D application pathways. The main elements of an integrated platform, which target tele-immersion and future 3D applications, are described in this paper, addressing the tasks of real-time capturing, robust 3D human shape/appearance reconstruction, and skeleton-based motion tracking. More specifically, initially, the details of a multiple RGB-depth (RGB-D) capturing system are given, along with a novel sensors' calibration method. A robust, fast reconstruction method from multiple RGB-D streams is then proposed, based on an enhanced variation of the volumetric Fourier transform-based method, parallelized on the Graphics Processing Unit, and accompanied with an appropriate texture-mapping algorithm. On top of that, given the lack of relevant objective evaluation methods, a novel framework is proposed for the quantitative evaluation of real-time 3D reconstruction systems. Finally, a generic, multiple depth stream-based method for accurate real-time human skeleton tracking is proposed. Detailed experimental results with multi-Kinect2 data sets verify the validity of our arguments and the effectiveness of the proposed system and methodologies.
ISSN:1051-8215
1558-2205
DOI:10.1109/TCSVT.2016.2576922