Recurrent Motion Refiner for Locomotion Stitching

• Published in: Computer graphics forum 2023-09, Vol.42 (6), p.n/a
• Main Authors: Kim, Haemin, Cho, Kyungmin, Hong, Seokhyeon, Noh, Junyong
• Format: Article
• Language: English
• Subjects: Animation; character animation; Coders; Interpolation; Locomotion; motion processing; motion stitching; Production methods; Stitching
• ISSN: 0167-7055; 1467-8659
• DOI: 10.1111/cgf.14920

Stitching different character motions is one of the most commonly used techniques as it allows the user to make new animations that fit one's purpose from pieces of motion. However, current motion stitching methods often produce unnatural motion with foot sliding artefacts, depending on the performance of the interpolation. In this paper, we propose a novel motion stitching technique based on a recurrent motion refiner (RMR) that connects discontinuous locomotions into a single natural locomotion. Our model receives different locomotions as input, in which the root of the last pose of the previous motion and that of the first pose of the next motion are aligned. During runtime, the model slides through the sequence, editing frames window by window to output a smoothly connected animation. Our model consists of a two‐layer recurrent network that comes between a simple encoder and decoder. To train this network, we created a sufficient number of paired data with a newly designed data generation. This process employs a K‐nearest neighbour search that explores a predefined motion database to create the corresponding input to the ground truth. Once trained, the suggested model can connect various lengths of locomotion sequences into a single natural locomotion. We propose a neural network‐based character locomotion stitching technique with recurrent motion refiner (RMR). We created paired data through novel data generation that employs K‐nearest neighbour search and trained our network to connect discontinuous locomotions into a single natural locomotion.