Systematic Review of the Hawthorne Effect: New Concepts Are Needed to Study Research Participation Effects

Overview

Journal J Clin Epidemiol

Publisher Elsevier

Specialty Public Health

Date 2013 Nov 27

PMID 24275499

Citations 771

Authors

Jim McCambridge

John Witton

Diana R Elbourne

Affiliations

Soon will be listed here.

Abstract

Objectives: This study aims to (1) elucidate whether the Hawthorne effect exists, (2) explore under what conditions, and (3) estimate the size of any such effect.

Study Design And Setting: This systematic review summarizes and evaluates the strength of available evidence on the Hawthorne effect. An inclusive definition of any form of research artifact on behavior using this label, and without cointerventions, was adopted.

Results: Nineteen purposively designed studies were included, providing quantitative data on the size of the effect in eight randomized controlled trials, five quasiexperimental studies, and six observational evaluations of reporting on one's behavior by answering questions or being directly observed and being aware of being studied. Although all but one study was undertaken within health sciences, study methods, contexts, and findings were highly heterogeneous. Most studies reported some evidence of an effect, although significant biases are judged likely because of the complexity of the evaluation object.

Conclusion: Consequences of research participation for behaviors being investigated do exist, although little can be securely known about the conditions under which they operate, their mechanisms of effects, or their magnitudes. New concepts are needed to guide empirical studies.

Citing Articles

Indoor positioning systems provide insight into emergency department systems enabling proposal of designs to improve workflow.

Huguet M, Pehlivan C, Ballereau F, Dodane-Loyenet A, Fontanili F, Garaix T Commun Med (Lond). 2025; 5(1):72.

PMID: 40069559 PMC: 11897186. DOI: 10.1038/s43856-025-00793-y.

Occupational Physical Activity Among Pregnant Employees in the Danish Workforce: The PRECISE Occupational Cohort Profile.

Frankel H, Haervig K, Flachs E, Korshoj M, Bertelsen C, Backhausen M Clin Epidemiol. 2025; 17:211-224.

PMID: 40051523 PMC: 11883179. DOI: 10.2147/CLEP.S496585.

An Assessment of Deep Learning's Impact on General Dentists' Ability to Detect Alveolar Bone Loss in 2D Intraoral Radiographs.

AlGhaihab A, Moretti A, Reside J, Tuzova L, Tyndall D Diagnostics (Basel). 2025; 15(4).

PMID: 40002618 PMC: 11854650. DOI: 10.3390/diagnostics15040467.

A novel proficiency test to assess the animal diagnostic investigation process in identifying an unknown toxicant.

Tkachenko A, Chen Y, Petrey M, Fritz S, Walsh T, Rotstein D Toxicol Rep. 2025; 14:101925.

PMID: 39989983 PMC: 11847136. DOI: 10.1016/j.toxrep.2025.101925.

Reducing physical assaults on residents through implementation of project BETA: Best practices in the evaluation and treatment of agitation.

Roppolo L, Choe J, Beyer L, Blumberg G, Morris D, Metzger J AEM Educ Train. 2025; 9(1):e11064.

PMID: 39959252 PMC: 11828699. DOI: 10.1002/aet2.11064.

References

McCarney R, Warner J, Iliffe S, Haselen R, Griffin M, Fisher P . The Hawthorne Effect: a randomised, controlled trial. BMC Med Res Methodol. 2007; 7:30. PMC: 1936999. DOI: 10.1186/1471-2288-7-30. View

Solomon R . An extension of control group design. Psychol Bull. 1949; 46(2):137-50. DOI: 10.1037/h0062958. View

Leonard K, Masatu M . Outpatient process quality evaluation and the Hawthorne Effect. Soc Sci Med. 2006; 63(9):2330-40. DOI: 10.1016/j.socscimed.2006.06.003. View

Fox N, Brennan J, Chasen S . Clinical estimation of fetal weight and the Hawthorne effect. Eur J Obstet Gynecol Reprod Biol. 2008; 141(2):111-4. DOI: 10.1016/j.ejogrb.2008.07.023. View

French D, Sutton S . Reactivity of measurement in health psychology: how much of a problem is it? What can be done about it?. Br J Health Psychol. 2010; 15(Pt 3):453-68. DOI: 10.1348/135910710X492341. View

McCambridge J, Butor-Bhavsar K, Witton J, Elbourne D . Can research assessments themselves cause bias in behaviour change trials? A systematic review of evidence from solomon 4-group studies. PLoS One. 2011; 6(10):e25223. PMC: 3198466. DOI: 10.1371/journal.pone.0025223. View

Wickstrom G, Bendix T . The "Hawthorne effect"--what did the original Hawthorne studies actually show?. Scand J Work Environ Health. 2000; 26(4):363-7. View

Mangione-Smith R, Elliott M, McDonald L, McGlynn E . An observational study of antibiotic prescribing behavior and the Hawthorne effect. Health Serv Res. 2003; 37(6):1603-23. PMC: 1464047. DOI: 10.1111/1475-6773.10482. View

Kompier M . The "Hawthorne effect" is a myth, but what keeps the story going?. Scand J Work Environ Health. 2006; 32(5):402-12. DOI: 10.5271/sjweh.1036. View

10.

McCambridge J, Kypri K . Can simply answering research questions change behaviour? Systematic review and meta analyses of brief alcohol intervention trials. PLoS One. 2011; 6(10):e23748. PMC: 3187747. DOI: 10.1371/journal.pone.0023748. View

11.

OSullivan I, Orbell S, Rakow T, Parker R . Prospective research in health service settings: health psychology, science and the 'Hawthorne' effect. J Health Psychol. 2004; 9(3):355-9. DOI: 10.1177/1359105304042345. View

12.

Ertem I, Votto N, LEVENTHAL J . The timing and predictors of the early termination of breastfeeding. Pediatrics. 2001; 107(3):543-8. DOI: 10.1542/peds.107.3.543. View

13.

Murray M, Swan A, Kiryluk S, Clarke G . The Hawthorne effect in the measurement of adolescent smoking. J Epidemiol Community Health. 1988; 42(3):304-6. PMC: 1052744. DOI: 10.1136/jech.42.3.304. View

14.

Higgins J, Thompson S . Quantifying heterogeneity in a meta-analysis. Stat Med. 2002; 21(11):1539-58. DOI: 10.1002/sim.1186. View

15.

Holden J . Hawthorne effects and research into professional practice. J Eval Clin Pract. 2001; 7(1):65-70. DOI: 10.1046/j.1365-2753.2001.00280.x. View

16.

Fernald D, Coombs L, DeAlleaume L, West D, Parnes B . An assessment of the Hawthorne Effect in practice-based research. J Am Board Fam Med. 2012; 25(1):83-6. DOI: 10.3122/jabfm.2012.01.110019. View

17.

Parsons H . What Happened at Hawthorne?: New evidence suggests the Hawthorne effect resulted from operant reinforcement contingencies. Science. 1974; 183(4128):922-32. DOI: 10.1126/science.183.4128.922. View

18.

Evans R, Joseph-Williams N, Edwards A, Newcombe R, Wright P, Kinnersley P . Supporting informed decision making for prostate specific antigen (PSA) testing on the web: an online randomized controlled trial. J Med Internet Res. 2010; 12(3):e27. PMC: 2956331. DOI: 10.2196/jmir.1305. View

19.

Leonard K . Is patient satisfaction sensitive to changes in the quality of care? An exploitation of the Hawthorne effect. J Health Econ. 2008; 27(2):444-59. DOI: 10.1016/j.jhealeco.2007.07.004. View

20.

Bouchet C, Guillemin F, Briancon S . Nonspecific effects in longitudinal studies: impact on quality of life measures. J Clin Epidemiol. 1996; 49(1):15-20. DOI: 10.1016/0895-4356(95)00540-4. View