BlanketGen - A synthetic blanket occlusion augmentation pipeline for MoCap datasets

Human motion analysis has seen drastic improvements recently, however, due to the lack of representative datasets, for clinical in-bed scenarios it is still lagging behind. To address this issue, we implemented BlanketGen, a pipeline that augments videos with synthetic blanket occlusions. With this...

Full description

Saved in:
Bibliographic Details
Published in:arXiv.org 2023-03
Main Authors: Carmona, João, Karácsony, Tamás, Silva Cunha, João Paulo
Format: Article
Language:English
Subjects:
Brain
Datasets
Human motion
Occlusion
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:Human motion analysis has seen drastic improvements recently, however, due to the lack of representative datasets, for clinical in-bed scenarios it is still lagging behind. To address this issue, we implemented BlanketGen, a pipeline that augments videos with synthetic blanket occlusions. With this pipeline, we generated an augmented version of the pose estimation dataset 3DPW called BlanketGen-3DPW. We then used this new dataset to fine-tune a Deep Learning model to improve its performance in these scenarios with promising results. Code and further information are available at https://gitlab.inesctec.pt/brain-lab/brain-lab-public/blanket-gen-releases.
ISSN:2331-8422
DOI:10.48550/arxiv.2210.12035