» Articles » PMID: 24812420

On Shrinkage and Model Extrapolation in the Evaluation of Clinical Center Performance

Overview
Journal Biostatistics
Specialty Public Health
Date 2014 May 10
PMID 24812420
Citations 16
Authors
Affiliations
Soon will be listed here.
Abstract

We consider statistical methods for benchmarking clinical centers based on a dichotomous outcome indicator. Borrowing ideas from the causal inference literature, we aim to reveal how the entire study population would have fared under the current care level of each center. To this end, we evaluate direct standardization based on fixed versus random center effects outcome models that incorporate patient-specific baseline covariates to adjust for differential case-mix. We explore fixed effects (FE) regression with Firth correction and normal mixed effects (ME) regression to maintain convergence in the presence of very small centers. Moreover, we study doubly robust FE regression to avoid outcome model extrapolation. Simulation studies show that shrinkage following standard ME modeling can result in substantial power loss relative to the considered alternatives, especially for small centers. Results are consistent with findings in the analysis of 30-day mortality risk following acute stroke across 90 centers in the Swedish Stroke Register.

Citing Articles

Cross-Sectoral Comparisons of Process Quality Indicators of Health Care Across Residential Regions Using Restricted Mean Survival Time.

Sinkovec H, Gall W, Heinze G Med Care. 2024; 62(11):748-756.

PMID: 39733232 PMC: 11462882. DOI: 10.1097/MLR.0000000000002057.


Limitations of the Inter-Unit Reliability: A Set of Practical Examples.

Hartman N, Shahinian V, Ashby V, Price K, He K Health Serv Outcomes Res Methodol. 2024; 24(2):156-169.

PMID: 39145149 PMC: 11323040. DOI: 10.1007/s10742-023-00307-0.


Evaluations of statistical methods for outlier detection when benchmarking in clinical registries: a systematic review.

Hansen J, Ahern S, Earnest A BMJ Open. 2023; 13(7):e069130.

PMID: 37451708 PMC: 10351235. DOI: 10.1136/bmjopen-2022-069130.


Clinics Optimizing MEthadone Take-homes for opioid use disorder (COMET): Protocol for a stepped-wedge randomized trial to facilitate clinic level changes.

Choi S, OGrady M, Cleland C, Knopf E, Hong S, DAunno T PLoS One. 2023; 18(6):e0286859.

PMID: 37294821 PMC: 10256218. DOI: 10.1371/journal.pone.0286859.


MEASURING PERFORMANCE FOR END-OF-LIFE CARE.

Haneuse S, Schrag D, Dominici F, Normand S, Lee K Ann Appl Stat. 2022; 16(3):1586-1607.

PMID: 36483542 PMC: 9728673. DOI: 10.1214/21-aoas1558.


References
1.
Rubin D . Estimating causal effects from large data sets using propensity scores. Ann Intern Med. 1998; 127(8 Pt 2):757-63. DOI: 10.7326/0003-4819-127-8_part_2-199710151-00064. View

2.
Hernan M, Robins J . Estimating causal effects from epidemiological data. J Epidemiol Community Health. 2006; 60(7):578-86. PMC: 2652882. DOI: 10.1136/jech.2004.029496. View

3.
DeLong E, Peterson E, Delong D, Muhlbaier L, Hackett S, Mark D . Comparing risk-adjustment methods for provider profiling. Stat Med. 1998; 16(23):2645-64. DOI: 10.1002/(sici)1097-0258(19971215)16:23<2645::aid-sim696>3.0.co;2-d. View

4.
White I, Carlin J . Bias and efficiency of multiple imputation compared with complete-case analysis for missing covariate values. Stat Med. 2010; 29(28):2920-31. DOI: 10.1002/sim.3944. View

5.
OBrien S, Dunson D . Bayesian multivariate logistic regression. Biometrics. 2004; 60(3):739-46. DOI: 10.1111/j.0006-341X.2004.00224.x. View