» Articles » PMID: 32879537

Detection of Item Preknowledge Using Response Times

Overview
Publisher Sage Publications
Date 2020 Sep 4
PMID 32879537
Citations 4
Authors
Affiliations
Soon will be listed here.
Abstract

Benefiting from item preknowledge is a major type of fraudulent behavior during educational assessments. This article suggests a new statistic that can be used for detecting the examinees who may have benefited from item preknowledge using their response times. The statistic quantifies the difference in speed between the compromised items and the non-compromised items of the examinees. The distribution of the statistic under the null hypothesis of no preknowledge is proved to be the standard normal distribution. A simulation study is used to evaluate the Type I error rate and power of the suggested statistic. A real data example demonstrates the usefulness of the new statistic that is found to provide information that is not provided by statistics based only on item scores.

Citing Articles

Few and Different: Detecting Examinees With Preknowledge Using Extended Isolation Forests.

Smith N, Keller L, Feinberg R, Liu C Appl Psychol Meas. 2025; :01466216251320403.

PMID: 39989924 PMC: 11843570. DOI: 10.1177/01466216251320403.


Application of Bayesian Decision Theory in Detecting Test Fraud.

Sinharay S, Johnson M Appl Psychol Meas. 2025; :01466216251316559.

PMID: 39881856 PMC: 11773507. DOI: 10.1177/01466216251316559.


Detecting Differential Item Functioning Using Response Time.

Duan Q, Cheng Y Educ Psychol Meas. 2024; :00131644241280400.

PMID: 39554768 PMC: 11562889. DOI: 10.1177/00131644241280400.


Multimodal Data Fusion to Detect Preknowledge Test-Taking Behavior Using Machine Learning.

Man K Educ Psychol Meas. 2024; 84(4):753-779.

PMID: 39055093 PMC: 11268392. DOI: 10.1177/00131644231193625.


What Can We Learn from a Semiparametric Factor Analysis of Item Responses and Response Time? An Illustration with the PISA 2015 Data.

Liu Y, Wang W Psychometrika. 2023; 89(2):386-410.

PMID: 37973773 DOI: 10.1007/s11336-023-09936-3.


References
1.
Sinharay S, Johnson M . The use of item scores and response times to detect examinees who may have benefited from item preknowledge. Br J Math Stat Psychol. 2019; 73(3):397-419. DOI: 10.1111/bmsp.12187. View

2.
Glas C, van der Linden W . Marginal likelihood inference for a model for item responses and response times. Br J Math Stat Psychol. 2010; 63(Pt 3):603-26. DOI: 10.1348/000711009X481360. View

3.
Ranger J . A note on the hierarchical model for responses and response times in tests of van der Linden (2007). Psychometrika. 2014; 78(3):538-44. DOI: 10.1007/s11336-013-9324-6. View

4.
Sinharay S . Which Statistic Should Be Used to Detect Item Preknowledge When the Set of Compromised Items Is Known?. Appl Psychol Meas. 2018; 41(6):403-421. PMC: 5978524. DOI: 10.1177/0146621617698453. View

5.
Wollack J, Cohen A, Eckerly C . Detecting Test Tampering Using Item Response Theory. Educ Psychol Meas. 2018; 75(6):931-953. PMC: 5965598. DOI: 10.1177/0013164414568716. View