Observational Studies: Practical Tips for Avoiding Common Statistical Pitfalls

Overview

Journal Lancet Reg Health Southeast Asia

Date 2024 Jun 12

PMID 38863985

Authors

Anna Freni Sterrantino

Affiliations

Soon will be listed here.

Abstract

This Personal View is intended for early-career researchers who are not yet experts in statistics. The Personal View focuses on common but usually avoidable flaws in the context of observational studies. I point out how study design, data collection, and statistical methods impact statistical results and research conclusions. With particular attention to study planning, sample selection, biases, lack of transparency and results misinterpretations.

Citing Articles

p-Values and confidence intervals as compatibility measures: guidelines for interpreting statistical studies in clinical research.

Rovetta A, Piretta L, Mansournia M Lancet Reg Health Southeast Asia. 2025; 33:100534.

PMID: 39945001 PMC: 11814670. DOI: 10.1016/j.lansea.2025.100534.

Writing for Clarity: A Concise Guide for Scientific Writing and Tips for Selecting a Journal.

Apoorv T Indian J Radiol Imaging. 2025; 35(Suppl 1):S49-S52.

PMID: 39802720 PMC: 11717450. DOI: 10.1055/s-0044-1800802.

Emerging Biomarkers and Determinants of Lipoprotein Profiles to Predict CVD Risk: Implications for Precision Nutrition.

Andersen C, Fernandez M Nutrients. 2025; 17(1.

PMID: 39796476 PMC: 11722654. DOI: 10.3390/nu17010042.

References

van der Bles A, van der Linden S, Freeman A, Mitchell J, Galvao A, Zaval L . Communicating uncertainty about facts, numbers and science. R Soc Open Sci. 2019; 6(5):181870. PMC: 6549952. DOI: 10.1098/rsos.181870. View

Thornton H, Cornish R, Lawlor D . Non-linear associations of maternal pre-pregnancy body mass index with risk of stillbirth, infant, and neonatal mortality in over 28 million births in the USA: a retrospective cohort study. EClinicalMedicine. 2023; 66:102351. PMC: 10730341. DOI: 10.1016/j.eclinm.2023.102351. View

Elston D . Cherry picking, HARKing, and P-hacking. J Am Acad Dermatol. 2021; . DOI: 10.1016/j.jaad.2021.06.844. View

Simera I, Moher D, Hirst A, Hoey J, Schulz K, Altman D . Transparent and accurate reporting increases reliability, utility, and impact of your research: reporting guidelines and the EQUATOR Network. BMC Med. 2010; 8:24. PMC: 2874506. DOI: 10.1186/1741-7015-8-24. View

Wong M, Koren G . Bias in maternal reports of smoking during pregnancy associated with fetal distress. Can J Public Health. 2001; 92(2):109-12. PMC: 6979636. View

Freni-Sterrantino A, Ghosh R, Fecht D, Toledano M, Elliott P, Hansell A . Bayesian spatial modelling for quasi-experimental designs: An interrupted time series study of the opening of Municipal Waste Incinerators in relation to infant mortality and sex ratio. Environ Int. 2019; 128:109-115. DOI: 10.1016/j.envint.2019.04.009. View

Intawong K, Chariyalertsak S, Chalom K, Wonghirundecha T, Kowatcharakul W, Thongprachum A . Effectiveness of heterologous third and fourth dose COVID-19 vaccine schedules for SARS-CoV-2 infection during delta and omicron predominance in Thailand: a test-negative, case-control study. Lancet Reg Health Southeast Asia. 2022; 10:100121. PMC: 9705195. DOI: 10.1016/j.lansea.2022.100121. View

Hammer G, du Prel J, Blettner M . Avoiding bias in observational studies: part 8 in a series of articles on evaluation of scientific publications. Dtsch Arztebl Int. 2009; 106(41):664-8. PMC: 2780010. DOI: 10.3238/arztebl.2009.0664. View

Hariton E, Locascio J . Randomised controlled trials - the gold standard for effectiveness research: Study design: randomised controlled trials. BJOG. 2018; 125(13):1716. PMC: 6235704. DOI: 10.1111/1471-0528.15199. View

10.

George P, Thakkar N, Yasobant S, Saxena D, Shah J . Impact of ambient air pollution and socio-environmental factors on the health of children younger than 5 years in India: a population-based analysis. Lancet Reg Health Southeast Asia. 2023; 20:100328. PMC: 10731218. DOI: 10.1016/j.lansea.2023.100328. View

11.

Sakboonyarat B, Rangsin R . Characteristics and clinical outcomes of people with hypertension receiving continuous care in Thailand: a cross-sectional study. Lancet Reg Health Southeast Asia. 2024; 21:100319. PMC: 10866948. DOI: 10.1016/j.lansea.2023.100319. View

12.

von Elm E, Altman D, Egger M, Pocock S, Gotzsche P, Vandenbroucke J . The Strengthening the Reporting of Observational Studies in Epidemiology (STROBE) statement: guidelines for reporting observational studies. Lancet. 2007; 370(9596):1453-7. DOI: 10.1016/S0140-6736(07)61602-X. View

13.

Grant M . This is the first study. Lancet. 2004; 364(9440):1126. DOI: 10.1016/S0140-6736(04)17096-7. View

14.

Nilsson L, Farahmand B, Persson P, Thiblin I, Tomson T . Risk factors for sudden unexpected death in epilepsy: a case-control study. Lancet. 1999; 353(9156):888-93. DOI: 10.1016/s0140-6736(98)05114-9. View

15.

Ghosh R, Freni-Sterrantino A, Douglas P, Parkes B, Fecht D, de Hoogh K . Fetal growth, stillbirth, infant mortality and other birth outcomes near UK municipal waste incinerators; retrospective population based cohort and case-control study. Environ Int. 2018; 122:151-158. DOI: 10.1016/j.envint.2018.10.060. View

16.

Dominici F, Zigler C . Best Practices for Gauging Evidence of Causality in Air Pollution Epidemiology. Am J Epidemiol. 2017; 186(12):1303-1309. PMC: 5860368. DOI: 10.1093/aje/kwx307. View

17.

Skelly A, Dettori J, Brodt E . Assessing bias: the importance of considering confounding. Evid Based Spine Care J. 2012; 3(1):9-12. PMC: 3503514. DOI: 10.1055/s-0031-1298595. View

18.

Pandis N . Bias in observational studies. Am J Orthod Dentofacial Orthop. 2014; 145(4):542-3. DOI: 10.1016/j.ajodo.2014.01.008. View

19.

Sarfraz A, Jamil Z, Ahmed S, Umrani F, Qureshi A, Jakhro S . Impact of diarrhoea and acute respiratory infection on environmental enteric dysfunction and growth of malnourished children in Pakistan: a longitudinal cohort study. Lancet Reg Health Southeast Asia. 2023; 15:100212. PMC: 10442970. DOI: 10.1016/j.lansea.2023.100212. View

20.

Krishnan A, Asadullah M, Kumar R, Amarchand R, Bhatia R, Roy A . Prevalence and determinants of delays in care among premature deaths due to acute cardiac conditions and stroke in residents of a district in India. Lancet Reg Health Southeast Asia. 2023; 15:100222. PMC: 10442961. DOI: 10.1016/j.lansea.2023.100222. View