TY - GEN
T1 - Multilabel Classification of Student Feedback Data Using BERT and Machine Learning Methods
AU - Setiawan, Hamzah
AU - Fatichah, Chastine
AU - Saikhu, Ahmad
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Studying student feedback is essential for educational institutions to provide good services to their students. The main purpose of evaluation is to improve the services offered to students through the interest monitoring information system. The guardian of each learner should provide feedback on infrastructure and learning services so that the educational institution can improve its services. In addition, the purpose of evaluation is to investigate student inquiries and receive responses from the appropriate departments to ensure the successful delivery of student services. Automatic classification of student feedback is necessary to improve response time and service quality. Student feedback should immediately follow the service to the relevant department, therefore the automated system classifies the feedback according to the unit handling it, prioritizing the most rapid development of the system. Each student feedback can be handled by more than two units, so the problem includes multilabel classification. This study aims at multi-label classification of student feedback data. This study uses a Bidirectional Encoder Representation from Transformers (BERT) to derive word vectors from student feedback data. In this study, several machine learning methods such as Support Vector Machines(SVM), K-Nearest Neighbors(KNN), Random Forests(RF), and Decision Trees(DT) are used to classify multi-label student feedback and compare their performances. This dataset consists of an assessment of the guardianship information system for 3323 students with the composition of the experiment using a comparison of 80% training data and 20% testing data. The SVM method with linear kernel has the best performance as evidenced by the accuracy of 82% and F1 value of 90%.
AB - Studying student feedback is essential for educational institutions to provide good services to their students. The main purpose of evaluation is to improve the services offered to students through the interest monitoring information system. The guardian of each learner should provide feedback on infrastructure and learning services so that the educational institution can improve its services. In addition, the purpose of evaluation is to investigate student inquiries and receive responses from the appropriate departments to ensure the successful delivery of student services. Automatic classification of student feedback is necessary to improve response time and service quality. Student feedback should immediately follow the service to the relevant department, therefore the automated system classifies the feedback according to the unit handling it, prioritizing the most rapid development of the system. Each student feedback can be handled by more than two units, so the problem includes multilabel classification. This study aims at multi-label classification of student feedback data. This study uses a Bidirectional Encoder Representation from Transformers (BERT) to derive word vectors from student feedback data. In this study, several machine learning methods such as Support Vector Machines(SVM), K-Nearest Neighbors(KNN), Random Forests(RF), and Decision Trees(DT) are used to classify multi-label student feedback and compare their performances. This dataset consists of an assessment of the guardianship information system for 3323 students with the composition of the experiment using a comparison of 80% training data and 20% testing data. The SVM method with linear kernel has the best performance as evidenced by the accuracy of 82% and F1 value of 90%.
KW - BERT
KW - Machine Learning
KW - Multilabel classification
KW - Pre-trained Word Embedding
KW - Student feedback
UR - http://www.scopus.com/inward/record.url?scp=85180362914&partnerID=8YFLogxK
U2 - 10.1109/ICTS58770.2023.10330849
DO - 10.1109/ICTS58770.2023.10330849
M3 - Conference contribution
AN - SCOPUS:85180362914
T3 - 2023 14th International Conference on Information and Communication Technology and System, ICTS 2023
SP - 147
EP - 152
BT - 2023 14th International Conference on Information and Communication Technology and System, ICTS 2023
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 14th International Conference on Information and Communication Technology and System, ICTS 2023
Y2 - 4 October 2023 through 5 October 2023
ER -