Feature Selection and Cancer Classification Via Sparse Logistic Regression with the Hybrid L1/2 +2 Regularization

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2016 May 3

PMID 27136190

Citations 18

Authors

Hai-Hui Huang

Xiao-Ying Liu

Yong Liang

Affiliations

Soon will be listed here.

Abstract

Cancer classification and feature (gene) selection plays an important role in knowledge discovery in genomic data. Although logistic regression is one of the most popular classification methods, it does not induce feature selection. In this paper, we presented a new hybrid L1/2 +2 regularization (HLR) function, a linear combination of L1/2 and L2 penalties, to select the relevant gene in the logistic regression. The HLR approach inherits some fascinating characteristics from L1/2 (sparsity) and L2 (grouping effect where highly correlated variables are in or out a model together) penalties. We also proposed a novel univariate HLR thresholding approach to update the estimated coefficients and developed the coordinate descent algorithm for the HLR penalized logistic regression model. The empirical results and simulations indicate that the proposed method is highly competitive amongst several state-of-the-art methods.

Citing Articles

Deep-GenMut: Automated genetic mutation classification in oncology: A deep learning comparative study.

Elsamahy E, Ahmed A, Shoala T, Maghraby F Heliyon. 2024; 10(11):e32279.

PMID: 38912449 PMC: 11190593. DOI: 10.1016/j.heliyon.2024.e32279.

Chronic Obstructive Pulmonary Disease: Novel Genes Detection with Penalized Logistic Regression.

Gohari K, Kazemnejad A, Mostafaei S, Saberi S, Sheidaei A Cell J. 2023; 25(3):203-211.

PMID: 37038700 PMC: 10105299. DOI: 10.22074/cellj.2022.557389.1048.

Prediction models with graph kernel regularization for network data.

Liu J, Chen H, Yang Y J Appl Stat. 2023; 50(6):1400-1417.

PMID: 37025276 PMC: 10071950. DOI: 10.1080/02664763.2022.2028745.

Identification of biomarkers predictive of metastasis development in early-stage colorectal cancer using network-based regularization.

Peixoto C, Lopes M, Martins M, Casimiro S, Sobral D, Grosso A BMC Bioinformatics. 2023; 24(1):17.

PMID: 36647008 PMC: 9841719. DOI: 10.1186/s12859-022-05104-z.

A novel meta-analysis based on data augmentation and elastic data shared lasso regularization for gene expression.

Huang H, Rao H, Miao R, Liang Y BMC Bioinformatics. 2022; 23(Suppl 10):353.

PMID: 35999505 PMC: 9396780. DOI: 10.1186/s12859-022-04887-5.

References

Kumar M, Hancock D, Molina-Arcas M, Steckel M, East P, Diefenbacher M . The GATA2 transcriptional network is requisite for RAS oncogene-driven non-small cell lung cancer. Cell. 2012; 149(3):642-55. DOI: 10.1016/j.cell.2012.02.059. View

Friedman J, Hastie T, Tibshirani R . Regularization Paths for Generalized Linear Models via Coordinate Descent. J Stat Softw. 2010; 33(1):1-22. PMC: 2929880. View

Singh D, Febbo P, Ross K, Jackson D, Manola J, Ladd C . Gene expression correlates of clinical prostate cancer behavior. Cancer Cell. 2002; 1(2):203-9. DOI: 10.1016/s1535-6108(02)00030-2. View

Shipp M, Ross K, Tamayo P, Weng A, Kutok J, Aguiar R . Diffuse large B-cell lymphoma outcome prediction by gene-expression profiling and supervised machine learning. Nat Med. 2002; 8(1):68-74. DOI: 10.1038/nm0102-68. View

Segal M, Dahlquist K, Conklin B . Regression approaches for microarray data analysis. J Comput Biol. 2004; 10(6):961-80. DOI: 10.1089/106652703322756177. View

Glaab E, Bacardit J, Garibaldi J, Krasnogor N . Using rule-based machine learning for candidate disease gene prioritization and sample classification of cancer gene expression data. PLoS One. 2012; 7(7):e39932. PMC: 3394775. DOI: 10.1371/journal.pone.0039932. View

Buckley S, Ehrhardt C . The receptor for advanced glycation end products (RAGE) and the lung. J Biomed Biotechnol. 2010; 2010:917108. PMC: 2817378. DOI: 10.1155/2010/917108. View

Jing R, Cui M, Wang J, Wang H . Receptor for advanced glycation end products (RAGE) soluble form (sRAGE): a new biomarker for lung cancer. Neoplasma. 2009; 57(1):55-61. DOI: 10.4149/neo_2010_01_055. View

Selamat S, Chung B, Girard L, Zhang W, Zhang Y, Campan M . Genome-scale analysis of DNA methylation in lung adenocarcinoma and integration with mRNA expression. Genome Res. 2012; 22(7):1197-211. PMC: 3396362. DOI: 10.1101/gr.132662.111. View

10.

Vicente C, Conchillo A, Garcia-Sanchez M, Odero M . The role of the GATA2 transcription factor in normal and malignant hematopoiesis. Crit Rev Oncol Hematol. 2011; 82(1):1-17. DOI: 10.1016/j.critrevonc.2011.04.007. View

11.

Liang Y, Liu C, Luan X, Leung K, Chan T, Xu Z . Sparse logistic regression with a L1/2 penalty for gene selection in cancer classification. BMC Bioinformatics. 2013; 14:198. PMC: 3718705. DOI: 10.1186/1471-2105-14-198. View

12.

Shen L, Tan E . Dimension reduction-based penalized logistic regression for cancer classification using microarray data. IEEE/ACM Trans Comput Biol Bioinform. 2006; 2(2):166-75. DOI: 10.1109/TCBB.2005.22. View

13.

Lecocke M, Hess K . An empirical study of univariate and genetic algorithm-based feature selection in binary classification with microarray data. Cancer Inform. 2009; 2:313-27. PMC: 2675488. View

14.

Becker N, Toedt G, Lichter P, Benner A . Elastic SCAD as a novel penalization method for SVM classification tasks in high-dimensional data. BMC Bioinformatics. 2011; 12:138. PMC: 3113938. DOI: 10.1186/1471-2105-12-138. View

15.

Huang H, Liang Y, Liu X . Network-Based Logistic Classification with an Enhanced L 1/2 Solver Reveals Biomarker and Subnetwork Signatures for Diagnosing Lung Cancer. Biomed Res Int. 2015; 2015:713953. PMC: 4488258. DOI: 10.1155/2015/713953. View

16.

Bartling B, Hofmann H, Weigle B, Silber R, Simm A . Down-regulation of the receptor for advanced glycation end-products (RAGE) supports non-small cell lung carcinoma. Carcinogenesis. 2004; 26(2):293-301. DOI: 10.1093/carcin/bgh333. View

17.

Wessels L, Reinders M, Hart A, Veenman C, Dai H, He Y . A protocol for building and evaluating predictors of disease state based on microarray data. Bioinformatics. 2005; 21(19):3755-62. DOI: 10.1093/bioinformatics/bti429. View

18.

Lu T, Tsai M, Lee J, Hsu C, Chen P, Lin C . Identification of a novel biomarker, SEMA5A, for non-small cell lung carcinoma in nonsmoking women. Cancer Epidemiol Biomarkers Prev. 2010; 19(10):2590-7. DOI: 10.1158/1055-9965.EPI-10-0332. View

19.

Dagliyan O, Uney-Yuksektepe F, Kavakli I, Turkay M . Optimization based tumor classification from microarray gene expression data. PLoS One. 2011; 6(2):e14579. PMC: 3033885. DOI: 10.1371/journal.pone.0014579. View

20.

Xu Z, Chang X, Xu F, Zhang H . L1/2 regularization: a thresholding representation theory and a fast solver. IEEE Trans Neural Netw Learn Syst. 2014; 23(7):1013-27. DOI: 10.1109/TNNLS.2012.2197412. View