TY - JOUR
T1 - Correction of Threshold Determination in Rapid-Guessing Behaviour Detection
AU - Alfian, Muhammad
AU - Yuhana, Umi Laili
AU - Pardede, Eric
AU - Bimantoro, Akbar Noto Ponco
N1 - Publisher Copyright:
© 2023 by the authors.
PY - 2023/7
Y1 - 2023/7
N2 - Assessment is one benchmark in measuring students’ abilities. However, assessment results cannot necessarily be trusted, because students sometimes cheat or even guess in answering the questions. Therefore, to obtain valid results, it is necessary to separate valid and invalid answers by considering rapid-guessing behaviour. We conducted a test to record exam log data from undergraduate and postgraduate students to model rapid-guessing behaviour by determining the threshold response time. Rapid-guessing behaviour detection is inspired by the common k-second method. However, the method flattens the application of the threshold, thus allowing misclassification. The modified method considers item difficulty in determining the threshold. The evaluation results show that the system can identify students’ rapid-guessing behaviour with a success rate of 71%, which is superior to the previous method. We also analysed various aggregation techniques of response time and compared them to see the effect of selecting the aggregation technique.
AB - Assessment is one benchmark in measuring students’ abilities. However, assessment results cannot necessarily be trusted, because students sometimes cheat or even guess in answering the questions. Therefore, to obtain valid results, it is necessary to separate valid and invalid answers by considering rapid-guessing behaviour. We conducted a test to record exam log data from undergraduate and postgraduate students to model rapid-guessing behaviour by determining the threshold response time. Rapid-guessing behaviour detection is inspired by the common k-second method. However, the method flattens the application of the threshold, thus allowing misclassification. The modified method considers item difficulty in determining the threshold. The evaluation results show that the system can identify students’ rapid-guessing behaviour with a success rate of 71%, which is superior to the previous method. We also analysed various aggregation techniques of response time and compared them to see the effect of selecting the aggregation technique.
KW - rapid-guessing behaviour
KW - response time
KW - threshold determination
UR - http://www.scopus.com/inward/record.url?scp=85166394045&partnerID=8YFLogxK
U2 - 10.3390/info14070422
DO - 10.3390/info14070422
M3 - Article
AN - SCOPUS:85166394045
SN - 2078-2489
VL - 14
JO - Information (Switzerland)
JF - Information (Switzerland)
IS - 7
M1 - 422
ER -