TY - GEN
T1 - Evaluation of Multi-Sensor Gloves Development as an Assistive Interpreter for Indonesian Sign Language
AU - Aponno, Dwisainstia
AU - Arifin, Achmad
AU - Fatoni, Muhammad Hilman
AU - Nuh, Mohammad
AU - Watanabe, Takashi
N1 - Publisher Copyright:
© 2022 IEEE.
PY - 2022
Y1 - 2022
N2 - Individuals who suffer in speaking and hearing are known as people with hearing and speech impairment. Sign language is used by them to communicate. Nevertheless, the general public does not fully comprehend sign language. In this study, assistive technology for the Indonesian Sign Language Interpretation System was developed to convert the alphabet sign into text. The system incorporates the usage of flex sensors, pressure sensor, and MPU6050 module. After the development, the evaluation for this interpreter is carried out. The classifier was able to identify 24 out of 26 alphabets with detection error frequently occurring in the letters N and R with an accuracy of 94% in the second experiment. By using a specific classification and including more test data, this study expected outcome can be heightened. The results show that the classification method, along with the tool, may be used effectively as a speech and hearing aid.
AB - Individuals who suffer in speaking and hearing are known as people with hearing and speech impairment. Sign language is used by them to communicate. Nevertheless, the general public does not fully comprehend sign language. In this study, assistive technology for the Indonesian Sign Language Interpretation System was developed to convert the alphabet sign into text. The system incorporates the usage of flex sensors, pressure sensor, and MPU6050 module. After the development, the evaluation for this interpreter is carried out. The classifier was able to identify 24 out of 26 alphabets with detection error frequently occurring in the letters N and R with an accuracy of 94% in the second experiment. By using a specific classification and including more test data, this study expected outcome can be heightened. The results show that the classification method, along with the tool, may be used effectively as a speech and hearing aid.
KW - Assistive Technology
KW - Data Gloves
KW - Hearing Impaired
KW - Multi-Sensor
KW - Sign Language
KW - Speech Impaired
UR - http://www.scopus.com/inward/record.url?scp=85149110805&partnerID=8YFLogxK
U2 - 10.1109/CENIM56801.2022.10037541
DO - 10.1109/CENIM56801.2022.10037541
M3 - Conference contribution
AN - SCOPUS:85149110805
T3 - Proceeding of the International Conference on Computer Engineering, Network and Intelligent Multimedia, CENIM 2022
SP - 179
EP - 184
BT - Proceeding of the International Conference on Computer Engineering, Network and Intelligent Multimedia, CENIM 2022
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2022 International Conference on Computer Engineering, Network and Intelligent Multimedia, CENIM 2022
Y2 - 22 November 2022 through 23 November 2022
ER -