» Articles » PMID: 31522841

Sample-Size Determination Methodologies for Machine Learning in Medical Imaging Research: A Systematic Review

Overview
Publisher Sage Publications
Specialty Radiology
Date 2019 Sep 17
PMID 31522841
Citations 86
Authors
Affiliations
Soon will be listed here.
Abstract

Purpose: The required training sample size for a particular machine learning (ML) model applied to medical imaging data is often unknown. The purpose of this study was to provide a descriptive review of current sample-size determination methodologies in ML applied to medical imaging and to propose recommendations for future work in the field.

Methods: We conducted a systematic literature search of articles using Medline and Embase with keywords including "machine learning," "image," and "sample size." The search included articles published between 1946 and 2018. Data regarding the ML task, sample size, and train-test pipeline were collected.

Results: A total of 167 articles were identified, of which 22 were included for qualitative analysis. There were only 4 studies that discussed sample-size determination methodologies, and 18 that tested the effect of sample size on model performance as part of an exploratory analysis. The observed methods could be categorized as pre hoc model-based approaches, which relied on features of the algorithm, or post hoc curve-fitting approaches requiring empirical testing to model and extrapolate algorithm performance as a function of sample size. Between studies, we observed great variability in performance testing procedures used for curve-fitting, model assessment methods, and reporting of confidence in sample sizes.

Conclusions: Our study highlights the scarcity of research in training set size determination methodologies applied to ML in medical imaging, emphasizes the need to standardize current reporting practices, and guides future work in development and streamlining of pre hoc and post hoc sample size approaches.

Citing Articles

Neural representation of consciously seen and unseen information.

Rodriguez-San Esteban P, Gonzalez-Lopez J, Chica A Sci Rep. 2025; 15(1):7888.

PMID: 40050698 PMC: 11885812. DOI: 10.1038/s41598-025-92490-y.


Impact of deep learning on pediatric elbow fracture detection: a systematic review and meta-analysis.

Binh L, Nhu N, Nhi P, Son D, Bach N, Huy H Eur J Trauma Emerg Surg. 2025; 51(1):115.

PMID: 39976732 DOI: 10.1007/s00068-025-02779-w.


Unsupervised Assessment of Frailty Status Using Wearable Sensors: A Feasibility Study among Community-Dwelling Older Adults.

Giggins O, Vavasour G, Doyle J Adv Rehabil Sci Pract. 2025; 14:27536351241311845.

PMID: 39958411 PMC: 11829299. DOI: 10.1177/27536351241311845.


Overlooked and underpowered: a meta-research addressing sample size in radiomics prediction models for binary outcomes.

Zhong J, Liu X, Lu J, Yang J, Zhang G, Mao S Eur Radiol. 2025; 35(3):1146-1156.

PMID: 39789271 PMC: 11835977. DOI: 10.1007/s00330-024-11331-0.


Structural Magnetic Resonance Imaging of Post-Traumatic Headache: A Systematic Review.

Christensen R, Al-Khazali H, Iljazi A, Szabo E, Ashina H Curr Pain Headache Rep. 2025; 29(1):20.

PMID: 39775377 DOI: 10.1007/s11916-024-01341-4.