» Articles » PMID: 35741437

Efficiency of the Adjusted Binary Classification (ABC) Approach in Osteometric Sex Estimation: A Comparative Study of Different Linear Machine Learning Algorithms and Training Sample Sizes

Overview
Journal Biology (Basel)
Publisher MDPI
Specialty Biology
Date 2022 Jun 24
PMID 35741437
Authors
Affiliations
Soon will be listed here.
Abstract

The adjusted binary classification (ABC) approach was proposed to assure that the binary classification model reaches a particular accuracy level. The present study evaluated the ABC for osteometric sex classification using multiple machine learning (ML) techniques: linear discriminant analysis (LDA), boosted generalized linear model (GLMB), support vector machine (SVM), and logistic regression (LR). We used 13 femoral measurements of 300 individuals from a modern Turkish population sample and split data into two sets: training (n = 240) and testing (n = 60). Then, the five best-performing measurements were selected for training univariate models, while pools of these variables were used for the multivariable models. ML classifier type did not affect the performance of unadjusted models. The accuracy of univariate models was 82−87%, while that of multivariate models was 89−90%. After applying ABC to the crossvalidation set, the accuracy and the positive and negative predictive values for uni- and multivariate models were ≥95%. Sex could be estimated for 28−75% of individuals using univariate models but with an obvious sexing bias, likely caused by different degrees of sexual dimorphism and between-group overlap. However, using multivariate models, we minimized the bias and properly classified 81−87% of individuals. A similar performance was also noted in the testing sample (except for FEB), with accuracies of 96−100%, and a proportion of classified individuals between 30% and 82% in univariate models, and between 90% and 91% in multivariate models. When considering different training sample sizes, we demonstrated that LR was the most sensitive with limited sample sizes (n < 150), while GLMB was the most stable classifier.

Citing Articles

Prioritizing a high posterior probability threshold leading to low error rate over high classification accuracy: the validity of MorphoPASSE software for cranial morphological sex estimation in a contemporary population.

Pilmann Koterova A, Santos F, Bejdova S, Rmoutilova R, Attia M, Habiba A Int J Legal Med. 2024; 138(4):1759-1768.

PMID: 38532206 DOI: 10.1007/s00414-024-03215-1.

References
1.
Parikh R, Mathai A, Parikh S, Sekhar G, Thomas R . Understanding and using sensitivity, specificity and predictive values. Indian J Ophthalmol. 2007; 56(1):45-50. PMC: 2636062. DOI: 10.4103/0301-4738.37595. View

2.
Gregory J, Aspden R . Femoral geometry as a risk factor for osteoporotic hip fracture in men and women. Med Eng Phys. 2008; 30(10):1275-86. DOI: 10.1016/j.medengphy.2008.09.002. View

3.
dOliveira Coelho J, Curate F . CADOES: An interactive machine-learning approach for sex estimation with the pelvis. Forensic Sci Int. 2019; 302:109873. DOI: 10.1016/j.forsciint.2019.109873. View

4.
Konigsberg L, Algee-Hewitt B, Steadman D . Estimation and evidence in forensic anthropology: sex and race. Am J Phys Anthropol. 2009; 139(1):77-90. DOI: 10.1002/ajpa.20934. View

5.
Mansournia M, Geroldinger A, Greenland S, Heinze G . Separation in Logistic Regression: Causes, Consequences, and Control. Am J Epidemiol. 2017; 187(4):864-870. DOI: 10.1093/aje/kwx299. View