TY - JOUR
T1 - Real-time Facial Expression Recognition to Enhance Emotional Intelligence in Autism
AU - Sholikah, Rizka Wakhidatus
AU - Hari Ginasrdi, R. V.
AU - Nugroho, Stefanus Lionel Carlo
AU - Ghozali, Khakim
AU - Indrawanti, Annisaa Sri
N1 - Publisher Copyright:
© 2023 The Authors. Published by Elsevier B.V.
PY - 2024
Y1 - 2024
N2 - The ability to interpret emotions from facial expressions is essential in social interaction. However, these abilities are complex for individuals with autism spectrum disorder (ASD). This study aims to develop a real-time human facial expression recognition system on a mobile phone application to help individuals with ASD. The expression recognition model was developed using the FER-2013 dataset with the VGG-16 architecture. The experimental results show that the model obtained from the VGG-16 architecture can produce the best accuracy and average F1 scores with 0.91 and 0.91, respectively. We also experiment with three individuals with ASD, resulting in increasing interest in learning the expression.
AB - The ability to interpret emotions from facial expressions is essential in social interaction. However, these abilities are complex for individuals with autism spectrum disorder (ASD). This study aims to develop a real-time human facial expression recognition system on a mobile phone application to help individuals with ASD. The expression recognition model was developed using the FER-2013 dataset with the VGG-16 architecture. The experimental results show that the model obtained from the VGG-16 architecture can produce the best accuracy and average F1 scores with 0.91 and 0.91, respectively. We also experiment with three individuals with ASD, resulting in increasing interest in learning the expression.
KW - Facial expression recognition; real-time
KW - VGG-16
KW - autism
KW - mobile app
UR - http://www.scopus.com/inward/record.url?scp=85193201669&partnerID=8YFLogxK
U2 - 10.1016/j.procs.2024.02.169
DO - 10.1016/j.procs.2024.02.169
M3 - Conference article
AN - SCOPUS:85193201669
SN - 1877-0509
VL - 234
SP - 222
EP - 229
JO - Procedia Computer Science
JF - Procedia Computer Science
T2 - 7th Information Systems International Conference, ISICO 2023
Y2 - 26 July 2023 through 28 July 2023
ER -