Mega-analysis Methods in ENIGMA: The Experience of the Generalized Anxiety Disorder Working Group

The ENIGMA group on Generalized Anxiety Disorder (ENIGMA-Anxiety/GAD) is part of a broader effort to investigate anxiety disorders using imaging and genetic data across multiple sites worldwide. The group is actively conducting a mega-analysis of a large number of brain structural scans. In this process, the group was confronted with many methodological challenges related to study planning and implementation, between-country transfer of subject-level data, quality control of a considerable amount of imaging data, and choices related to statistical methods and efficient use of resources. This report summarizes the background information and rationale for the various methodological decisions, as well as the approach taken to implement them. The goal is to document the approach and help guide other research groups working with large brain imaging data sets as they develop their own analytic pipelines for mega-analyses.

Citing Articles

Longitudinal development of resting-state functional connectivity in adolescents with and without internalizing disorders.

Roelofs E, Bas-Hoogendam J, Winkler A, Van der Wee N, Vermeiren R Neurosci Appl. 2024; 3.

PMID: 39634556 PMC: 11615185. DOI: 10.1016/j.nsa.2024.104090.

Constructing and exploring neuroimaging projects: a survey from clinical practice to scientific research.

Chen Z, Adegboro A, Gu L, Li X Insights Imaging. 2024; 15(1):272.

PMID: 39546176 PMC: 11568082. DOI: 10.1186/s13244-024-01848-9.

A generalizable normative deep autoencoder for brain morphological anomaly detection: application to the multi-site StratiBip dataset on bipolar disorder in an external validation framework.

Sampaio I, Tassi E, Bellani M, Benedetti F, Nenadic I, Phillips M bioRxiv. 2024; .

PMID: 39282436 PMC: 11398360. DOI: 10.1101/2024.09.04.611239.

Uncovering the hidden effects of repetitive subconcussive head impact exposure: A mega-analytic approach characterizing seasonal brain microstructural changes in contact and collision sports athletes.

Kwiatkowski A, Weidler C, Habel U, Coverdale N, Hirad A, Manning K Hum Brain Mapp. 2024; 45(12):e26811.

PMID: 39185683 PMC: 11345636. DOI: 10.1002/hbm.26811.

Characterizing patterns of diffusion tensor imaging variance in aging brains.

Gao C, Yang Q, Kim M, Khairi N, Cai L, Newlin N J Med Imaging (Bellingham). 2024; 11(4):044007.

PMID: 39185477 PMC: 11344569. DOI: 10.1117/1.JMI.11.4.044007.

References

Dietrich O, Raya J, Reeder S, Reiser M, Schoenberg S . Measurement of signal-to-noise ratios in MR images: influence of multichannel coils, parallel imaging, and reconstruction filters. J Magn Reson Imaging. 2007; 26(2):375-85. DOI: 10.1002/jmri.20969. View

Dale A, Fischl B, Sereno M . Cortical surface-based analysis. I. Segmentation and surface reconstruction. Neuroimage. 1999; 9(2):179-94. DOI: 10.1006/nimg.1998.0395. View

Kong X, Mathias S, Guadalupe T, Glahn D, Franke B, Crivello F . Mapping cortical brain asymmetry in 17,141 healthy individuals worldwide via the ENIGMA Consortium. Proc Natl Acad Sci U S A. 2018; 115(22):E5154-E5163. PMC: 5984496. DOI: 10.1073/pnas.1718418115. View

Roseman M, Milette K, Bero L, Coyne J, Lexchin J, Turner E . Reporting of conflicts of interest in meta-analyses of trials of pharmacological treatments. JAMA. 2011; 305(10):1008-17. DOI: 10.1001/jama.2011.257. View

Tahmasian M, Sepehry A, Samea F, Khodadadifar T, Soltaninejad Z, Javaheripour N . Practical recommendations to conduct a neuroimaging meta-analysis for neuropsychiatric disorders. Hum Brain Mapp. 2019; 40(17):5142-5154. PMC: 6865620. DOI: 10.1002/hbm.24746. View

Moreno Arellano A, Dai W, Wang S, Jiang X, Ohno-Machado L . Privacy Policy and Technology in Biomedical Data Science. Annu Rev Biomed Data Sci. 2019; 1:115-129. PMC: 6497413. DOI: 10.1146/annurev-biodatasci-080917-013416. View

Brett M, Johnsrude I, Owen A . The problem of functional localization in the human brain. Nat Rev Neurosci. 2002; 3(3):243-9. DOI: 10.1038/nrn756. View

Fox P, Lancaster J, Laird A, Eickhoff S . Meta-analysis in human neuroimaging: computational modeling of large-scale databases. Annu Rev Neurosci. 2014; 37:409-34. PMC: 4782802. DOI: 10.1146/annurev-neuro-062012-170320. View

. The Nine Circles of Scientific Hell. Perspect Psychol Sci. 2015; 7(6):643-4. DOI: 10.1177/1745691612459519. View

10.

Destrieux C, Fischl B, Dale A, Halgren E . Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature. Neuroimage. 2010; 53(1):1-15. PMC: 2937159. DOI: 10.1016/j.neuroimage.2010.06.010. View

11.

Ho T, Gutman B, Pozzi E, Grabe H, Hosten N, Wittfeld K . Subcortical shape alterations in major depressive disorder: Findings from the ENIGMA major depressive disorder working group. Hum Brain Mapp. 2020; 43(1):341-351. PMC: 8675412. DOI: 10.1002/hbm.24988. View

12.

Muller V, Cieslik E, Laird A, Fox P, Radua J, Mataix-Cols D . Ten simple rules for neuroimaging meta-analysis. Neurosci Biobehav Rev. 2017; 84:151-161. PMC: 5918306. DOI: 10.1016/j.neubiorev.2017.11.012. View

13.

Arslan S, Ktena S, Makropoulos A, Robinson E, Rueckert D, Parisot S . Human brain mapping: A systematic comparison of parcellation methods for the human cerebral cortex. Neuroimage. 2017; 170:5-30. DOI: 10.1016/j.neuroimage.2017.04.014. View

14.

Zugman A, Harrewijn A, Cardinale E, Zwiebel H, Freitag G, Werwath K . Mega-analysis methods in ENIGMA: The experience of the generalized anxiety disorder working group. Hum Brain Mapp. 2020; 43(1):255-277. PMC: 8675407. DOI: 10.1002/hbm.25096. View

15.

Bas-Hoogendam J, Groenewold N, Aghajani M, Freitag G, Harrewijn A, Hilbert K . ENIGMA-anxiety working group: Rationale for and organization of large-scale neuroimaging studies of anxiety disorders. Hum Brain Mapp. 2020; 43(1):83-112. PMC: 8805695. DOI: 10.1002/hbm.25100. View

16.

Staunton C, Slokenberga S, Mascalzoni D . The GDPR and the research exemption: considerations on the necessary safeguards for research biobanks. Eur J Hum Genet. 2019; 27(8):1159-1167. PMC: 6777499. DOI: 10.1038/s41431-019-0386-5. View

17.

Johnson W, Li C, Rabinovic A . Adjusting batch effects in microarray expression data using empirical Bayes methods. Biostatistics. 2006; 8(1):118-27. DOI: 10.1093/biostatistics/kxj037. View

18.

Smith S, Nichols T . Threshold-free cluster enhancement: addressing problems of smoothing, threshold dependence and localisation in cluster inference. Neuroimage. 2008; 44(1):83-98. DOI: 10.1016/j.neuroimage.2008.03.061. View

19.

Jovicich J, Czanner S, Greve D, Haley E, van der Kouwe A, Gollub R . Reliability in multi-site structural MRI studies: effects of gradient non-linearity correction on phantom and human data. Neuroimage. 2005; 30(2):436-43. DOI: 10.1016/j.neuroimage.2005.09.046. View

20.

Ciric R, Wolf D, Power J, Roalf D, Baum G, Ruparel K . Benchmarking of participant-level confound regression strategies for the control of motion artifact in studies of functional connectivity. Neuroimage. 2017; 154:174-187. PMC: 5483393. DOI: 10.1016/j.neuroimage.2017.03.020. View