Integrative Data Analysis: the Simultaneous Analysis of Multiple Data Sets

Overview

Journal Psychol Methods

Publisher American Psychological Association

Specialty Psychology

Date 2009 Jun 3

PMID 19485623

Citations 306

Authors

Patrick J Curran

Andrea M Hussong

Affiliations

Soon will be listed here.

Abstract

There are both quantitative and methodological techniques that foster the development and maintenance of a cumulative knowledge base within the psychological sciences. Most noteworthy of these techniques is meta-analysis, which allows for the synthesis of summary statistics drawn from multiple studies when the original data are not available. However, when the original data can be obtained from multiple studies, many advantages stem from the statistical analysis of the pooled data. The authors define integrative data analysis (IDA) as the analysis of multiple data sets that have been pooled into one. Although variants of IDA have been incorporated into other scientific disciplines, the use of these techniques is much less evident in psychology. In this article the authors present an overview of IDA as it may be applied within the psychological sciences, discuss the relative advantages and disadvantages of IDA, describe analytic strategies for analyzing pooled individual data, and offer recommendations for the use of IDA in practice.

Citing Articles

Exploring the development of face recognition across childhood via logistic mixed-effects modelling of the standardised Cambridge Face Memory Test.

Ewing L, Althaus N, Farran E, Papasavva M, Mares I, Smith M Behav Res Methods. 2025; 57(4):113.

PMID: 40064748 PMC: 11893692. DOI: 10.3758/s13428-025-02629-y.

Robust Automated Harmonization of Heterogeneous Data Through Ensemble Machine Learning: Algorithm Development and Validation Study.

Yang D, Zhou D, Cai S, Gan Z, Pencina M, Avillach P JMIR Med Inform. 2025; 13:e54133.

PMID: 39844378 PMC: 11778729. DOI: 10.2196/54133.

Intentionality and Congruence Cues Shape Young Children's Perceptions of Identity-Based Group Membership.

Straka B, Stanaland A, Gaither S Dev Sci. 2024; 28(2):e13607.

PMID: 39740226 PMC: 11685800. DOI: 10.1111/desc.13607.

Perceptions of sexual assault perpetrators, victims, and event depend on system justification beliefs and perpetrator atonement.

Delker B, Means K, Schwam A, Patterson A, Fogel C, Brown A PLoS One. 2024; 19(12):e0311983.

PMID: 39739832 PMC: 11687665. DOI: 10.1371/journal.pone.0311983.

Extending the Environmental influences on Child Health Outcomes (ECHO) Cohort through 2030: Rationale and study protocol.

Blackwell C, Cella D, Adair L, Cordero J, Das S, Elliott A PLoS One. 2024; 19(12):e0312677.

PMID: 39724080 PMC: 11670998. DOI: 10.1371/journal.pone.0312677.

References

Wirth R, Edwards M . Item factor analysis: current approaches and future directions. Psychol Methods. 2007; 12(1):58-79. PMC: 3162326. DOI: 10.1037/1082-989X.12.1.58. View

Miyazaki Y, Raudenbush S . Tests for linkage of multiple cohorts in an accelerated longitudinal design. Psychol Methods. 2000; 5(1):44-63. DOI: 10.1037/1082-989x.5.1.44. View

STEVENS S . On the Theory of Scales of Measurement. Science. 1946; 103(2684):677-80. DOI: 10.1126/science.103.2684.677. View

Millsap R . Measurement Invariance, Predictive Invariance, and the Duality Paradox. Multivariate Behav Res. 2016; 30(4):577-605. DOI: 10.1207/s15327906mbr3004_6. View

Kaplow J, Curran P, Dodge K . Child, parent, and peer predictors of early-onset substance use: a multisite longitudinal study. J Abnorm Child Psychol. 2002; 30(3):199-216. PMC: 2758661. DOI: 10.1023/a:1015183927979. View

Bauer D, Curran P . Probing Interactions in Fixed and Multilevel Regression: Inferential and Graphical Techniques. Multivariate Behav Res. 2016; 40(3):373-400. DOI: 10.1207/s15327906mbr4003_5. View

Cooper H, Patall E . The relative benefits of meta-analysis conducted with individual participant data versus aggregated data. Psychol Methods. 2009; 14(2):165-76. DOI: 10.1037/a0015565. View

Smith M, Glass G . Meta-analysis of psychotherapy outcome studies. Am Psychol. 1977; 32(9):752-60. DOI: 10.1037//0003-066x.32.9.752. View

Curran P, Hussong A, Cai L, Huang W, Chassin L, Sher K . Pooling data from multiple longitudinal studies: the role of item response theory in integrative data analysis. Dev Psychol. 2008; 44(2):365-80. PMC: 2894156. DOI: 10.1037/0012-1649.44.2.365. View

10.

Berlin J, Santanna J, Schmid C, Szczech L, Feldman H . Individual patient- versus group-level data meta-regressions for the investigation of treatment effect modifiers: ecological bias rears its ugly head. Stat Med. 2002; 21(3):371-87. DOI: 10.1002/sim.1023. View

11.

Flora D, Curran P . An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychol Methods. 2004; 9(4):466-91. PMC: 3153362. DOI: 10.1037/1082-989X.9.4.466. View

12.

Hussong A, Wirth R, Edwards M, Curran P, Chassin L, Zucker R . Externalizing symptoms among children of alcoholic parents: Entry points for an antisocial pathway to alcoholism. J Abnorm Psychol. 2007; 116(3):529-42. PMC: 2842994. DOI: 10.1037/0021-843X.116.3.529. View

13.

Pentz M, Chou C . Measurement invariance in longitudinal clinical research assuming change from development and intervention. J Consult Clin Psychol. 1994; 62(3):450-62. DOI: 10.1037//0022-006x.62.3.450. View

14.

McArdle J, Grimm K, Hamagami F, Bowles R, Meredith W . Modeling life-span growth curves of cognition using longitudinal data with multiple samples and changing scales of measurement. Psychol Methods. 2009; 14(2):126-49. PMC: 2831479. DOI: 10.1037/a0015857. View

15.

Harford T . The effects of order of questions on reported alcohol consumption. Addiction. 1994; 89(4):421-4. DOI: 10.1111/j.1360-0443.1994.tb00916.x. View

16.

Hussong A, Bauer D, Huang W, Chassin L, Sher K, Zucker R . Characterizing the life stressors of children of alcoholic parents. J Fam Psychol. 2008; 22(6):819-32. PMC: 2765873. DOI: 10.1037/a0013704. View

17.

Chassin L, Rogosch F, Barrera M . Substance use and symptomatology among adolescent children of alcoholics. J Abnorm Psychol. 1991; 100(4):449-63. DOI: 10.1037//0021-843x.100.4.449. View

18.

Higgins J, Whitehead A, Turner R, Omar R, Thompson S . Meta-analysis of continuous outcome data from individual patients. Stat Med. 2001; 20(15):2219-41. DOI: 10.1002/sim.918. View

19.

Hussong A, Flora D, Curran P, Chassin L, Zucker R . Defining risk heterogeneity for internalizing symptoms among children of alcoholic parents. Dev Psychopathol. 2008; 20(1):165-93. PMC: 2249558. DOI: 10.1017/S0954579408000084. View

20.

Bollen K . Latent variables in psychology and the social sciences. Annu Rev Psychol. 2001; 53:605-34. DOI: 10.1146/annurev.psych.53.100901.135239. View