Automatic analysis of complex athlete techniques in broadcast taekwondo video

• Published in: Multimedia tools and applications 2018-06, Vol.77 (11), p.13643-13660
• Main Authors: Kong, Yongqiang, Wei, Zhengang, Huang, Shanshan
• Format: Article
• Language: English
• Subjects: Athletes; Computer Communication Networks; Computer Science; Data Structures and Information Theory; Frames; Machine learning; Martial arts; Moving object recognition; Multimedia Information Systems; Special Purpose and Application-Based Systems; Video broadcasting
• ISSN: 1380-7501; 1573-7721
• DOI: 10.1007/s11042-017-4979-0

Athlete detection and action recognition in sports video is a very challenging task due to the dynamic and cluttered background. Several attempts for automatic analysis focus on athletes in many sports videos have been made. However, taekwondo video analysis remains an unstudied field. In light of this, a novel framework for automatic techniques analysis in broadcast taekwondo video is proposed in this paper. For an input video, in the first stage, athlete tracking and body segmentation are done through a modified Structure Preserving Object Tracker. In the second stage, the de-noised frames which completely contain the body of analyzed athlete from video sequence, are trained by a deep learning network PCANet to predict the athlete action of each single frame. As one technique is composed of many consecutive actions and each action corresponds a video frame, focusing on video sequences to achieve techniques analysis makes sense. In the last stage, linear SVM is used with the predicted action frames to get a techniques classifier. To evaluate the performance of the proposed framework, extensive experiments on real broadcast taekwondo video dataset are provided. The results show that the proposed method achieves state-of-the-art results for complex techniques analysis in taekwondo video.