» Articles » PMID: 36131198

Do You Know the Wooly Bully? Testing Era-based Knowledge to Verify Participant Age Online

Overview
Publisher Springer
Specialty Social Sciences
Date 2022 Sep 21
PMID 36131198
Authors
Affiliations
Soon will be listed here.
Abstract

People in online studies sometimes misrepresent themselves. Regardless of their motive for doing so, participant misrepresentation threatens the validity of research. Here, we propose and evaluate a way to verify the age of online respondents: a test of era-based knowledge. Across six studies (N = 1543), participants of various ages completed an age verification instrument. The instrument assessed familiarity with cultural phenomena (e.g., songs and TV shows) from decades past and present. We consistently found that our instrument discriminated between people of different ages. In Studies 1a and 1b, self-reported age correlated strongly with performance on the instrument (mean r = .8). In Study 2, the instrument reliably detected imposters who we knew were misrepresenting their age. For impostors, self-reported age did not correlate with performance on the instrument (r = .077). Finally, in Studies 3a, 3b, and 3c, the instrument remained robust with African Americans, people from low educational backgrounds, and recent immigrants to the United States. Thus, our instrument shows promise for verifying the age of online respondents, and, as we discuss, our approach of assessing "insider knowledge" holds great promise for verifying other identities within online studies.

References
1.
Beier M, Ackerman P . Current-events knowledge in adults: an investigation of age, intelligence, and nonability determinants. Psychol Aging. 2002; 16(4):615-28. View

2.
Chandler J, Rosenzweig C, Moss A, Robinson J, Litman L . Online panels in social science research: Expanding sampling methods beyond Mechanical Turk. Behav Res Methods. 2019; 51(5):2022-2038. PMC: 6797699. DOI: 10.3758/s13428-019-01273-7. View

3.
Chandler J, Sisso I, Shapiro D . Participant carelessness and fraud: Consequences for clinical research and potential solutions. J Abnorm Psychol. 2019; 129(1):49-55. DOI: 10.1037/abn0000479. View

4.
Hauser D, Schwarz N . Attentive Turkers: MTurk participants perform better on online attention checks than do subject pool participants. Behav Res Methods. 2015; 48(1):400-7. DOI: 10.3758/s13428-015-0578-z. View

5.
Kahana M, Howard M, Zaromb F, Wingfield A . Age dissociates recency and lag recency effects in free recall. J Exp Psychol Learn Mem Cogn. 2002; 28(3):530-40. DOI: 10.1037//0278-7393.28.3.530. View