Comparing Stacking Ensemble Techniques to Improve Musculoskeletal Fracture Image Classification

Overview

Journal J Imaging

Publisher MDPI

Specialty Radiology

Date 2024 Jul 31

PMID 39080888

Authors

Ibrahem Kandel

Mauro Castelli

Ales Popovic

Affiliations

Soon will be listed here.

Abstract

Bone fractures are among the main reasons for emergency room admittance and require a rapid response from doctors. Bone fractures can be severe and can lead to permanent disability if not treated correctly and rapidly. Using X-ray imaging in the emergency room to detect fractures is a challenging task that requires an experienced radiologist, a specialist who is not always available. The availability of an automatic tool for image classification can provide a second opinion for doctors operating in the emergency room and reduce the error rate in diagnosis. This study aims to increase the existing state-of-the-art convolutional neural networks' performance by using various ensemble techniques. In this approach, different CNNs (Convolutional Neural Networks) are used to classify the images; rather than choosing the best one, a stacking ensemble provides a more reliable and robust classifier. The ensemble model outperforms the results of individual CNNs by an average of 10%.

Citing Articles

Enhancing genomic prediction with Stacking Ensemble Learning in Arabica Coffee.

Nascimento M, Nascimento A, Azevedo C, Oliveira A, Caixeta E, Jarquin D Front Plant Sci. 2024; 15:1373318.

PMID: 39086911 PMC: 11288849. DOI: 10.3389/fpls.2024.1373318.

Trustworthy deep learning framework for the detection of abnormalities in X-ray shoulder images.

Alzubaidi L, Salhi A, Fadhel M, Bai J, Hollman F, Italia K PLoS One. 2024; 19(3):e0299545.

PMID: 38466693 PMC: 10927121. DOI: 10.1371/journal.pone.0299545.

Stacked ensemble deep learning for pancreas cancer classification using extreme gradient boosting.

Bakasa W, Viriri S Front Artif Intell. 2023; 6:1232640.

PMID: 37876961 PMC: 10591225. DOI: 10.3389/frai.2023.1232640.

Non-annotated renal histopathological image analysis with deep ensemble learning.

Koo J, Ke Q, Hum Y, Goh C, Lai K, Yap W Quant Imaging Med Surg. 2023; 13(9):5902-5920.

PMID: 37711826 PMC: 10498232. DOI: 10.21037/qims-23-46.

Deep Transfer Learning with Enhanced Feature Fusion for Detection of Abnormalities in X-ray Images.

Alammar Z, Alzubaidi L, Zhang J, Li Y, Lafta W, Gu Y Cancers (Basel). 2023; 15(15).

PMID: 37568821 PMC: 10417687. DOI: 10.3390/cancers15154007.

References

Gulshan V, Peng L, Coram M, Stumpe M, Wu D, Narayanaswamy A . Development and Validation of a Deep Learning Algorithm for Detection of Diabetic Retinopathy in Retinal Fundus Photographs. JAMA. 2016; 316(22):2402-2410. DOI: 10.1001/jama.2016.17216. View

Brinker M, OConnor D . The incidence of fractures and dislocations referred for orthopaedic services in a capitated population. J Bone Joint Surg Am. 2004; 86(2):290-7. View

LeCun Y, Bengio Y, Hinton G . Deep learning. Nature. 2015; 521(7553):436-44. DOI: 10.1038/nature14539. View

Rajaraman S, Siegelman J, Alderson P, Folio L, Folio L, Antani S . Iteratively Pruned Deep Learning Ensembles for COVID-19 Detection in Chest X-rays. IEEE Access. 2020; 8:115041-115050. PMC: 7394290. DOI: 10.1109/access.2020.3003810. View

Chung S, Han S, Lee J, Oh K, Kim N, Yoon J . Automated detection and classification of the proximal humerus fracture by using deep learning algorithm. Acta Orthop. 2018; 89(4):468-473. PMC: 6066766. DOI: 10.1080/17453674.2018.1453714. View

Olczak J, Fahlberg N, Maki A, Sharif Razavian A, Jilert A, Stark A . Artificial intelligence for analyzing orthopedic trauma radiographs. Acta Orthop. 2017; 88(6):581-586. PMC: 5694800. DOI: 10.1080/17453674.2017.1344459. View

Dell R, Greene D, Schelkun S, Williams K . Osteoporosis disease management: the role of the orthopaedic surgeon. J Bone Joint Surg Am. 2008; 90 Suppl 4:188-94. DOI: 10.2106/JBJS.H.00628. View

Kandel I, Castelli M, Popovic A . Musculoskeletal Images Classification for Detection of Fractures Using Transfer Learning. J Imaging. 2021; 6(11). PMC: 8321195. DOI: 10.3390/jimaging6110127. View

Cummings P, Koepsell T, Mueller B . Methodological challenges in injury epidemiology and injury prevention research. Annu Rev Public Health. 1995; 16:381-400. DOI: 10.1146/annurev.pu.16.050195.002121. View

10.

Cha D, Pae C, Seong S, Choi J, Park H . Automated diagnosis of ear disease using ensemble deep learning with a big otoendoscopy image database. EBioMedicine. 2019; 45:606-614. PMC: 6642402. DOI: 10.1016/j.ebiom.2019.06.050. View

11.

Barton N . Twenty questions about scaphoid fractures. J Hand Surg Br. 1992; 17(3):289-310. DOI: 10.1016/0266-7681(92)90118-l. View

12.

Kitamura G, Chung C, Moore 2nd B . Ankle Fracture Detection Utilizing a Convolutional Neural Network Ensemble Implemented with a Small Sample, De Novo Training, and Multiview Incorporation. J Digit Imaging. 2019; 32(4):672-677. PMC: 6646476. DOI: 10.1007/s10278-018-0167-7. View

13.

Urinbayev K, Orazbek Y, Nurambek Y, Mirzakhmetov A, Varol H . End-to-End Deep Diagnosis of X-ray Images. Annu Int Conf IEEE Eng Med Biol Soc. 2020; 2020:2182-2185. DOI: 10.1109/EMBC44109.2020.9175208. View

14.

Curtis E, van der Velde R, Moon R, van den Bergh J, Geusens P, de Vries F . Epidemiology of fractures in the United Kingdom 1988-2012: Variation with age, sex, geography, ethnicity and socioeconomic status. Bone. 2016; 87:19-26. PMC: 4890652. DOI: 10.1016/j.bone.2016.03.006. View

15.

Gabler C, Kukla C, Breitenseher M, Trattnig S, Vecsei V . Diagnosis of occult scaphoid fractures and other wrist injuries. Are repeated clinical examinations and plain radiographs still state of the art?. Langenbecks Arch Surg. 2001; 386(2):150-4. DOI: 10.1007/s004230000195. View

16.

Scott E, Gaywood I, Scott B . Guidelines for osteoporosis in coeliac disease and inflammatory bowel disease. British Society of Gastroenterology. Gut. 2000; 46 Suppl 1:i1-8. PMC: 1766735. DOI: 10.1136/gut.46.suppl_1.i1. View

17.

. Osteoporosis prevention, diagnosis, and therapy. JAMA. 2001; 285(6):785-95. DOI: 10.1001/jama.285.6.785. View

18.

Lindsey R, Daluiski A, Chopra S, Lachapelle A, Mozer M, Sicular S . Deep neural network improves fracture detection by clinicians. Proc Natl Acad Sci U S A. 2018; 115(45):11591-11596. PMC: 6233134. DOI: 10.1073/pnas.1806905115. View