Detection of Challenging Behaviours of Children with Autism Using Wearable Sensors during Interactions with Social Robots

• Main Authors: Alban, Ahmad Qadeib, Ayesh, Malek, Alhaddad, Ahmad Yaser, Khalid Al-Ali, Abdulaziz, So, Wing Chee, Connor, Olcay, Cabibihan, John-John
• Format: Conference Proceeding
• Language: English
• Subjects: Autism; Machine learning; Machine learning algorithms; Medical treatment; Pediatrics; Robot sensing systems; Wearable computers
• ISSN: 1944-9437
• DOI: 10.1109/RO-MAN50785.2021.9515459

Autism spectrum disorder is a neurodevelopmental disorder that is characterized by patterns of behaviours and difficulties with social communication and interaction. Children on the spectrum exhibit atypical, restricted, repetitive, and challenging behaviours. In this study, we investigate the feasibility of integrating wearable sensors and machine learning techniques to detect the occurrence of challenging behaviours in real-time. A session of a child with autism interacting with different stimuli groups that included social robots was annotated with observed challenging behaviors. The child wore a wearable device that captured different motion and physiological signals. Different features and machine learning configurations were investigated to identify the most effective combination. Our results showed that physiological signals in addition to typical kinetic measures led to more accurate predictions. The best features and learning model combination achieved an accuracy of 97%. The findings of this work motivate research toward methods of early detection of challenging behaviours, which may enable the timely intervention by caregivers and possibly by social robots.