Gesture recognition based on multilevel multimodal feature fusion

With the development of human-computer interaction, gesture recognition has gradually become one of the research hotspots. The cost reduction and the richer information of RGB-D images make the research of gesture recognition based on RGB-D images more and more. However, the current gesture processi...

Full description

Saved in:
Bibliographic Details
Published in:Journal of intelligent & fuzzy systems 2020-01, Vol.38 (3), p.2539-2550
Main Authors: Tian, Jinrong, Cheng, Wentao, Sun, Ying, Li, Gongfa, Jiang, Du, Jiang, Guozhang, Tao, Bo, Zhao, Haoyi, Chen, Disi
Format: Article
Language:English
Subjects:
Feature extraction
Gesture recognition
Mapping
Multilevel
Object recognition
Splicing
Citations: Items that this one cites
Items that cite this one
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:With the development of human-computer interaction, gesture recognition has gradually become one of the research hotspots. The cost reduction and the richer information of RGB-D images make the research of gesture recognition based on RGB-D images more and more. However, the current gesture processing methods for RGB-D images still can not fully utilize the information contained. Aiming at the above problems, this paper studies the feature extraction method of RGB-D image, and proposes a multimodal and multilevel feature extraction method. By extracting multimodal and multilevel image features for mapping and splicing, the utilization of RGB-D image information and the accuracy in recognition are improved effectively. Finally, the experiments verified the effectiveness and robustness of the proposed method based on the self-built gesture database. Compared and analyzed with several other RGB-D processing methods, the processing method of this paper is more advanced and effective, and can achieve better results in gesture recognition.
ISSN:1064-1246
1875-8967
DOI:10.3233/JIFS-179541