Parallel multi-stage rectification networks for 3D skeleton-based motion prediction

It is noted that Recurrent Neural Networks (RNNs), which are widely used in human prediction tasks, have achieved promising performance in motion prediction, owing to RNNs’ robust capacity for spatial-temporal sequence modeling. However, RNN-based methods suffer from error accumulation due to their...

Full description

Saved in:
Bibliographic Details
Published in:Scientific reports 2024-10, Vol.14 (1), p.26058-14, Article 26058
Main Authors: Zhong, Jianqi, Ye, Conghui, Cao, Wenming, Wang, Hao
Format: Article
Language:English
Subjects:
639/166
639/166/987
639/166/988
Collaboration
Deep learning
Error accumulation
Humanities and Social Sciences
Information processing
Motion prediction
multidisciplinary
Neural networks
Predictions
Recurrent neural network
Science
Science (multidisciplinary)
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:It is noted that Recurrent Neural Networks (RNNs), which are widely used in human prediction tasks, have achieved promising performance in motion prediction, owing to RNNs’ robust capacity for spatial-temporal sequence modeling. However, RNN-based methods suffer from error accumulation due to their step-by-step prediction mechanism. Therefore, in this paper, we propose a three-stage parallel prediction network, which guides the output generation of these three networks with different objectives. In particular, we leverage the high-dimensional information in these three networks to fuse new information to generate the final output. In addition, we also designed a fusion block based on GRU and attention mechanism to extract high-dimensional information more efficiently. Extensive experiments show that our approach outperforms most recent methods in both short and long-term motion predictions on Human 3.6M, CMU Mocap, and 3DPW.
ISSN:2045-2322
2045-2322
DOI:10.1038/s41598-024-75782-7