Evaluation of Bias-variance Trade-off for Commonly Used Post-summarizing Normalization Procedures in Large-scale Gene Expression Studies

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2014 Jun 19

PMID 24941114

Citations 8

Authors

Xing Qiu

Rui Hu

Zhixin Wu

Affiliations

Soon will be listed here.

Abstract

Normalization procedures are widely used in high-throughput genomic data analyses to remove various technological noise and variations. They are known to have profound impact to the subsequent gene differential expression analysis. Although there has been some research in evaluating different normalization procedures, few attempts have been made to systematically evaluate the gene detection performances of normalization procedures from the bias-variance trade-off point of view, especially with strong gene differentiation effects and large sample size. In this paper, we conduct a thorough study to evaluate the effects of normalization procedures combined with several commonly used statistical tests and MTPs under different configurations of effect size and sample size. We conduct theoretical evaluation based on a random effect model, as well as simulation and biological data analyses to verify the results. Based on our findings, we provide some practical guidance for selecting a suitable normalization procedure under different scenarios.

Citing Articles

FastMix: a versatile data integration pipeline for cell type-specific biomarker inference.

Zhang Y, Sun H, Mandava A, Aevermann B, Kollmann T, Scheuermann R Bioinformatics. 2022; 38(20):4735-4744.

PMID: 36018232 PMC: 9801972. DOI: 10.1093/bioinformatics/btac585.

Airway gene-expression classifiers for respiratory syncytial virus (RSV) disease severity in infants.

Wang L, Chu C, McCall M, Slaunwhite C, Holden-Wiltse J, Corbett A BMC Med Genomics. 2021; 14(1):57.

PMID: 33632195 PMC: 7908785. DOI: 10.1186/s12920-021-00913-2.

Microarray Normalization Revisited for Reproducible Breast Cancer Biomarkers.

Kenn M, Cacsire Castillo-Tong D, Singer C, Cibena M, Kolbl H, Schreiner W Biomed Res Int. 2020; 2020:1363827.

PMID: 32832541 PMC: 7428878. DOI: 10.1155/2020/1363827.

Defining housekeeping genes suitable for RNA-seq analysis of the human allograft kidney biopsy tissue.

Wang Z, Lyu Z, Pan L, Zeng G, Randhawa P BMC Med Genomics. 2019; 12(1):86.

PMID: 31208411 PMC: 6580566. DOI: 10.1186/s12920-019-0538-z.

Aims, Study Design, and Enrollment Results From the Assessing Predictors of Infant Respiratory Syncytial Virus Effects and Severity Study.

Walsh E, Mariani T, Chu C, Grier A, Gill S, Qiu X JMIR Res Protoc. 2019; 8(6):e12907.

PMID: 31199303 PMC: 6595944. DOI: 10.2196/12907.

References

Tsodikov A, Szabo A, Jones D . Adjustments and measures of differential expression for microarray data. Bioinformatics. 2002; 18(2):251-60. DOI: 10.1093/bioinformatics/18.2.251. View

Johnson W, Li C, Rabinovic A . Adjusting batch effects in microarray expression data using empirical Bayes methods. Biostatistics. 2006; 8(1):118-27. DOI: 10.1093/biostatistics/kxj037. View

Bullard J, Purdom E, Hansen K, Dudoit S . Evaluation of statistical methods for normalization and differential expression in mRNA-Seq experiments. BMC Bioinformatics. 2010; 11:94. PMC: 2838869. DOI: 10.1186/1471-2105-11-94. View

Huber W, von Heydebreck A, Sultmann H, Poustka A, Vingron M . Variance stabilization applied to microarray data calibration and to the quantification of differential expression. Bioinformatics. 2002; 18 Suppl 1:S96-104. DOI: 10.1093/bioinformatics/18.suppl_1.s96. View

Yang Y, Dudoit S, Luu P, Lin D, Peng V, Ngai J . Normalization for cDNA microarray data: a robust composite method addressing single and multiple slide systematic variation. Nucleic Acids Res. 2002; 30(4):e15. PMC: 100354. DOI: 10.1093/nar/30.4.e15. View

Hu R, Qiu X, Glazko G, Klebanov L, Yakovlev A . Detecting intergene correlation changes in microarray analysis: a new approach to gene selection. BMC Bioinformatics. 2009; 10:20. PMC: 2657217. DOI: 10.1186/1471-2105-10-20. View

Qiu X, Brooks A, Klebanov L, Yakovlev N . The effects of normalization on the correlation structure of microarray data. BMC Bioinformatics. 2005; 6:120. PMC: 1156869. DOI: 10.1186/1471-2105-6-120. View

Qiu X, Wu H, Hu R . The impact of quantile and rank normalization procedures on the testing power of gene differential expression analysis. BMC Bioinformatics. 2013; 14:124. PMC: 3660216. DOI: 10.1186/1471-2105-14-124. View

Dunning M, Smith M, Ritchie M, Tavare S . beadarray: R classes and methods for Illumina bead-based data. Bioinformatics. 2007; 23(16):2183-4. DOI: 10.1093/bioinformatics/btm311. View

10.

Bremer M, Himelblau E, Madlung A . Introduction to the statistical analysis of two-color microarray data. Methods Mol Biol. 2010; 620:287-313. DOI: 10.1007/978-1-60761-580-4_9. View

11.

Tusher V, Tibshirani R, Chu G . Significance analysis of microarrays applied to the ionizing radiation response. Proc Natl Acad Sci U S A. 2001; 98(9):5116-21. PMC: 33173. DOI: 10.1073/pnas.091062498. View

12.

Gagnon-Bartsch J, Speed T . Using control genes to correct for unwanted variation in microarray data. Biostatistics. 2011; 13(3):539-52. PMC: 3577104. DOI: 10.1093/biostatistics/kxr034. View

13.

Schmid R, Baum P, Ittrich C, Fundel-Clemens K, Huber W, Brors B . Comparison of normalization methods for Illumina BeadChip HumanHT-12 v3. BMC Genomics. 2010; 11:349. PMC: 3091625. DOI: 10.1186/1471-2164-11-349. View

14.

Qin L, Satagopan J . Normalization method for transcriptional studies of heterogeneous samples--simultaneous array normalization and identification of equivalent expression. Stat Appl Genet Mol Biol. 2009; 8:Article 10. PMC: 2861326. DOI: 10.2202/1544-6115.1339. View

15.

Szabo A, Boucher K, Carroll W, Klebanov L, Tsodikov A, Yakovlev A . Variable selection and pattern recognition with gene expression data generated by the microarray technology. Math Biosci. 2002; 176(1):71-98. DOI: 10.1016/s0025-5564(01)00103-1. View

16.

Hu R, Qiu X, Glazko G . A new gene selection procedure based on the covariance distance. Bioinformatics. 2009; 26(3):348-54. PMC: 2815661. DOI: 10.1093/bioinformatics/btp672. View

17.

Park T, Yi S, Kang S, Lee S, Lee Y, Simon R . Evaluation of normalization methods for microarray data. BMC Bioinformatics. 2003; 4:33. PMC: 200968. DOI: 10.1186/1471-2105-4-33. View

18.

Dai M, Wang P, Boyd A, Kostov G, Athey B, Jones E . Evolving gene/transcript definitions significantly alter the interpretation of GeneChip data. Nucleic Acids Res. 2005; 33(20):e175. PMC: 1283542. DOI: 10.1093/nar/gni179. View

19.

Robinson M, Speed T . A comparison of Affymetrix gene expression arrays. BMC Bioinformatics. 2007; 8:449. PMC: 2216046. DOI: 10.1186/1471-2105-8-449. View

20.

Ross M, Shurtleff S, Williams W, Patel D, Mahfouz R, Behm F . Classification, subtype discovery, and prediction of outcome in pediatric acute lymphoblastic leukemia by gene expression profiling. Cancer Cell. 2002; 1(2):133-43. DOI: 10.1016/s1535-6108(02)00032-6. View