Deep learning-based sign language recognition system for static signs

• Published in: Neural computing & applications 2020-06, Vol.32 (12), p.7957-7968
• Main Authors: Wadhawan, Ankita, Kumar, Parteek
• Format: Article
• Language: English
• Subjects: Artificial Intelligence; Artificial neural networks; Computational Biology/Bioinformatics; Computational Science and Engineering; Computer Science; Computer vision; Data Mining and Knowledge Discovery; Deep learning; Human communication; Image Processing and Computer Vision; Machine learning; Probability and Statistics in Computer Science; Recognition; S.I. : Hybrid Artificial Intelligence and Machine Learning Technologies; Sign language; Signs; Vision systems
• ISSN: 0941-0643; 1433-3058
• DOI: 10.1007/s00521-019-04691-y

Sign language for communication is efficacious for humans, and vital research is in progress in computer vision systems. The earliest work in Indian Sign Language (ISL) recognition considers the recognition of significant differentiable hand signs and therefore often selecting a few signs from the ISL for recognition. This paper deals with robust modeling of static signs in the context of sign language recognition using deep learning-based convolutional neural networks (CNN). In this research, total 35,000 sign images of 100 static signs are collected from different users. The efficiency of the proposed system is evaluated on approximately 50 CNN models. The results are also evaluated on the basis of different optimizers, and it has been observed that the proposed approach has achieved the highest training accuracy of 99.72% and 99.90% on colored and grayscale images, respectively. The performance of the proposed system has also been evaluated on the basis of precision, recall and F -score. The system also demonstrates its effectiveness over the earlier works in which only a few hand signs are considered for recognition.