Detection of Item Preknowledge Using Response Times
Overview
Authors
Affiliations
Benefiting from item preknowledge is a major type of fraudulent behavior during educational assessments. This article suggests a new statistic that can be used for detecting the examinees who may have benefited from item preknowledge using their response times. The statistic quantifies the difference in speed between the compromised items and the non-compromised items of the examinees. The distribution of the statistic under the null hypothesis of no preknowledge is proved to be the standard normal distribution. A simulation study is used to evaluate the Type I error rate and power of the suggested statistic. A real data example demonstrates the usefulness of the new statistic that is found to provide information that is not provided by statistics based only on item scores.
Few and Different: Detecting Examinees With Preknowledge Using Extended Isolation Forests.
Smith N, Keller L, Feinberg R, Liu C Appl Psychol Meas. 2025; :01466216251320403.
PMID: 39989924 PMC: 11843570. DOI: 10.1177/01466216251320403.
Application of Bayesian Decision Theory in Detecting Test Fraud.
Sinharay S, Johnson M Appl Psychol Meas. 2025; :01466216251316559.
PMID: 39881856 PMC: 11773507. DOI: 10.1177/01466216251316559.
Detecting Differential Item Functioning Using Response Time.
Duan Q, Cheng Y Educ Psychol Meas. 2024; :00131644241280400.
PMID: 39554768 PMC: 11562889. DOI: 10.1177/00131644241280400.
Multimodal Data Fusion to Detect Preknowledge Test-Taking Behavior Using Machine Learning.
Man K Educ Psychol Meas. 2024; 84(4):753-779.
PMID: 39055093 PMC: 11268392. DOI: 10.1177/00131644231193625.
Liu Y, Wang W Psychometrika. 2023; 89(2):386-410.
PMID: 37973773 DOI: 10.1007/s11336-023-09936-3.