An Overview of Behavioral Recognition

• Published in: Information technology and control 2024-06, Vol.53 (2), p.619-652
• Main Authors: Xie, Yunjie, Xiang, Jian, Li, Xiaoyong, Duan, Jiawen, Li, Zhiqiang
• Format: Article
• Language: English
• ISSN: 1392-124X; 2335-884X
• DOI: 10.5755/j01.itc.53.2.35769

Human behavior recognition has become a popular research topic in the field of computer vision. With the introduction of deep learning and attention mechanisms, this field has been further promoted. However, issues such as dataset acquisition and preprocessing operations on multimodal datasets, modeling of long time information in videos, and fusion of temporal and spatial information still exist. In this paper, we first outline some video action recognition datasets and related preprocessing techniques, including frame extraction, optical flow extraction, and skeletal feature acquisition. Then, the relevant models are classified and parsed according to their characteristics and the types of input data modalities. In addition, we evaluate the performance of the models on several benchmark datasets to gain a deeper understanding of the model development process. Finally, we summarized the current challenges faced in the field of video behavior recognition, including model timeliness, data set subjectivity and effective fusion of multi-modal features, and proposed possible future improvement directions in order to provide more ideas and methods for subsequent research.