Real-time Facial Expression Recognition to Enhance Emotional Intelligence in Autism

The ability to interpret emotions from facial expressions is essential in social interaction. However, these abilities are complex for individuals with autism spectrum disorder (ASD). This study aims to develop a real-time human facial expression recognition system on a mobile phone application to h...

Full description

Saved in:
Bibliographic Details
Published in:Procedia computer science 2024, Vol.234, p.222-229
Main Authors: Sholikah, Rizka Wakhidatus, Ginasrdi, R V Hari, Nugroho, Stefanus Lionel Carlo, Ghozali, Khakim, Indrawanti, Annisaa Sri
Format: Article
Language:English
Subjects:
Facial expression recognition
real-time, mobile app, VGG-16, autism
Citations: Items that this one cites
Online Access:Get full text
Tags: Add Tag
No Tags, Be the first to tag this record!
Description
Summary:The ability to interpret emotions from facial expressions is essential in social interaction. However, these abilities are complex for individuals with autism spectrum disorder (ASD). This study aims to develop a real-time human facial expression recognition system on a mobile phone application to help individuals with ASD. The expression recognition model was developed using the FER-2013 dataset with the VGG-16 architecture. The experimental results show that the model obtained from the VGG-16 architecture can produce the best accuracy and average F1 scores with 0.91 and 0.91, respectively. We also experiment with three individuals with ASD, resulting in increasing interest in learning the expression.
ISSN:1877-0509
1877-0509
DOI:10.1016/j.procs.2024.02.169