TY - JOUR
T1 - A Context-based Question Selection Model to Support the Adaptive Assessment of Learning
T2 - A study of online learning assessment in elementary schools in Indonesia
AU - Yuhana, Umi Laili
AU - Yuniarno, Eko Mulyanto
AU - Rahayu, Wenny
AU - Pardede, Eric
N1 - Publisher Copyright:
© The Author(s), under exclusive licence to Springer Science+Business Media, LLC, part of Springer Nature 2023.
PY - 2024/6
Y1 - 2024/6
N2 - In an online learning environment, it is important to establish a suitable assessment approach that can be adapted on the fly to accommodate the varying learning paces of students. At the same time, it is essential that assessment criteria remain compliant with the expected learning outcomes of the relevant education standard which predominantly utilizes a competency-based curriculum such as in Indonesia. The aim of the research in this paper is to improve the adaptiveness of questions in the existing Computerized Adaptive Testing (CAT) model by taking into consideration multiple aspects of user context. We propose a context-based question selection model based on competency evaluation by merging four methods of Classical Test Theory, Rasch Model, Linear and Quadratic models, and the combination of branching and item adaptive methods to select questions of suitable difficulty for each individual student. To evaluate the proposed model, we conducted experiments based on a real dataset of 689 elementary school students in Indonesia. The experiment results prove the effectiveness of the proposed model in terms of accuracy in predicting the appropriateness of the questions in relation to the students’ ability. This adaptive assessment method which accurately builds upon the students’ competency level will support students’ success in the online learning environment.
AB - In an online learning environment, it is important to establish a suitable assessment approach that can be adapted on the fly to accommodate the varying learning paces of students. At the same time, it is essential that assessment criteria remain compliant with the expected learning outcomes of the relevant education standard which predominantly utilizes a competency-based curriculum such as in Indonesia. The aim of the research in this paper is to improve the adaptiveness of questions in the existing Computerized Adaptive Testing (CAT) model by taking into consideration multiple aspects of user context. We propose a context-based question selection model based on competency evaluation by merging four methods of Classical Test Theory, Rasch Model, Linear and Quadratic models, and the combination of branching and item adaptive methods to select questions of suitable difficulty for each individual student. To evaluate the proposed model, we conducted experiments based on a real dataset of 689 elementary school students in Indonesia. The experiment results prove the effectiveness of the proposed model in terms of accuracy in predicting the appropriateness of the questions in relation to the students’ ability. This adaptive assessment method which accurately builds upon the students’ competency level will support students’ success in the online learning environment.
KW - Adaptive assessment
KW - Competency
KW - Context-based question selection
KW - Multiple aspects of user context
KW - Rasch Model
KW - Student’s ability
UR - http://www.scopus.com/inward/record.url?scp=85171258976&partnerID=8YFLogxK
U2 - 10.1007/s10639-023-12184-8
DO - 10.1007/s10639-023-12184-8
M3 - Article
AN - SCOPUS:85171258976
SN - 1360-2357
VL - 29
SP - 9517
EP - 9540
JO - Education and Information Technologies
JF - Education and Information Technologies
IS - 8
ER -