TY - GEN
T1 - Facial Expression Recognition on Video Data with Various Face Poses Using Deep Learning
AU - Nafis, Ayas Faikar
AU - Navastara, Dini Adni
AU - Yuniarti, Anny
N1 - Publisher Copyright:
© 2020 IEEE.
PY - 2020/10/6
Y1 - 2020/10/6
N2 - Facial expressions in humans produce non-verbal communication to convey emotional states in humans; hence, they play an essential role in social interactions between humans. Along with the times, research on facial expression analysis has expanded to automatic facial expression recognition by computers. The facial expression recognition plays a vital role in human-computer interactions, monitoring human behavior, educational techniques, psychological, to sociable robots. In this study, the development of human facial expression recognition was carried out using a deep learning method called You Only Look Once (YOLO) based on Convolutional Neural Network (CNN). There are seven classes of facial expressions that can be recognized, namely angry, disgust, fear, happy, sadness, surprise, and neutral. The datasets used are video-based facial expression datasets such as CK+, IMED, and video data from 8 students of the Informatics Department, Institut Teknologi Sepuluh Nopember (ITS), with various face poses. Based on the experimental results, the best accuracy of the still image dataset is 94% on the CK+ dataset with channel three and learning rate 0.01. Moreover, the accuracy of video data with various face poses achieves 73%.
AB - Facial expressions in humans produce non-verbal communication to convey emotional states in humans; hence, they play an essential role in social interactions between humans. Along with the times, research on facial expression analysis has expanded to automatic facial expression recognition by computers. The facial expression recognition plays a vital role in human-computer interactions, monitoring human behavior, educational techniques, psychological, to sociable robots. In this study, the development of human facial expression recognition was carried out using a deep learning method called You Only Look Once (YOLO) based on Convolutional Neural Network (CNN). There are seven classes of facial expressions that can be recognized, namely angry, disgust, fear, happy, sadness, surprise, and neutral. The datasets used are video-based facial expression datasets such as CK+, IMED, and video data from 8 students of the Informatics Department, Institut Teknologi Sepuluh Nopember (ITS), with various face poses. Based on the experimental results, the best accuracy of the still image dataset is 94% on the CK+ dataset with channel three and learning rate 0.01. Moreover, the accuracy of video data with various face poses achieves 73%.
KW - CNN
KW - Facial Expression Recognition
KW - YOLO
KW - deep learning
KW - various face poses
KW - video data
UR - https://www.scopus.com/pages/publications/85098714086
U2 - 10.1109/ICITEE49829.2020.9271740
DO - 10.1109/ICITEE49829.2020.9271740
M3 - Conference contribution
AN - SCOPUS:85098714086
T3 - ICITEE 2020 - Proceedings of the 12th International Conference on Information Technology and Electrical Engineering
SP - 362
EP - 367
BT - ICITEE 2020 - Proceedings of the 12th International Conference on Information Technology and Electrical Engineering
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 12th International Conference on Information Technology and Electrical Engineering, ICITEE 2020
Y2 - 6 October 2020 through 8 October 2020
ER -