Assessing handwriting task difficulty levels through kinematic features: a deep-learning approach

• Published in: Frontiers in robotics and AI 2023-09, Vol.10, p.1193388-1193388
• Main Authors: Babushkin, Vahan, Alsuradi, Haneen, Jamil, Muhammad Hassan, Al-Khalil, Muhamed Osman, Eid, Mohamad
• Format: Article
• Language: English
• Subjects: artificial neural networks; deep learning; learning from demonstration; machine learning; Robotics and AI; sensorimotor learning
• ISSN: 2296-9144; 2296-9144
• DOI: 10.3389/frobt.2023.1193388

Introduction: Handwriting is a complex task that requires coordination of motor, sensory, cognitive, memory, and linguistic skills to master. The extent these processes are involved depends on the complexity of the handwriting task. Evaluating the difficulty of a handwriting task is a challenging problem since it relies on subjective judgment of experts. Methods: In this paper, we propose a machine learning approach for evaluating the difficulty level of handwriting tasks. We propose two convolutional neural network (CNN) models for single- and multilabel classification where single-label classification is based on the mean of expert evaluation while the multilabel classification predicts the distribution of experts’ assessment. The models are trained with a dataset containing 117 spatio-temporal features from the stylus and hand kinematics, which are recorded for all letters of the Arabic alphabet. Results: While single- and multilabel classification models achieve decent accuracy (96% and 88% respectively) using all features, the hand kinematics features do not significantly influence the performance of the models. Discussion: The proposed models are capable of extracting meaningful features from the handwriting samples and predicting their difficulty levels accurately. The proposed approach has the potential to be used to personalize handwriting learning tools and provide automatic evaluation of the quality of handwriting.