» Articles » PMID: 29928846

An Evaluation of Amazon's Mechanical Turk, Its Rapid Rise, and Its Effective Use

Overview
Specialty Psychology
Date 2018 Jun 22
PMID 29928846
Citations 109
Authors
Affiliations
Soon will be listed here.
Abstract

Over the past 2 decades, many social scientists have expanded their data-collection capabilities by using various online research tools. In the 2011 article "Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality, data?" in Perspectives on Psychological Science, Buhrmester, Kwang, and Gosling introduced researchers to what was then considered to be a promising but nascent research platform. Since then, thousands of social scientists from seemingly every field have conducted research using the platform. Here, we reflect on the impact of Mechanical Turk on the social sciences and our article's role in its rise, provide the newest data-driven recommendations to help researchers effectively use the platform, and highlight other online research platforms worth consideration.

Citing Articles

TurkMedNLI: a Turkish medical natural language inference dataset through large language model based translation.

Ogul I, Soygazi F, Bostanoglu B PeerJ Comput Sci. 2025; 11:e2662.

PMID: 40062299 PMC: 11888880. DOI: 10.7717/peerj-cs.2662.


Validation of an online imitation-inhibition task.

Westfal M, Cracco E, Crusius J, Genschow O Behav Res Methods. 2025; 57(2):80.

PMID: 39884989 PMC: 11782408. DOI: 10.3758/s13428-024-02557-3.


Towards a unified measure of general interpersonal trust.

Hoang U, Tanner B, Mahmoud-Elhaj D, Holt J, Asif M, Feltz A Heliyon. 2024; 10(23):e40624.

PMID: 39654742 PMC: 11626050. DOI: 10.1016/j.heliyon.2024.e40624.


Psychometric properties of the American version of the Chronic Uncertainty scale: long and short version (CU-40; CU-20).

Ghassabei S, Afifi W, Afifi T, Petrowski K BMC Psychol. 2024; 12(1):699.

PMID: 39605078 PMC: 11603752. DOI: 10.1186/s40359-024-02206-6.


Concerns, Worries, and Fears During Pregnancy in Active-Duty United States Air Force Families.

Milner J, Crouch J, Ammar J, Jensen A, Travis W, Wagner M J Perinat Educ. 2024; 33(2):52-64.

PMID: 39399784 PMC: 11467706. DOI: 10.1891/JPE-2023-0005.