On Shrinkage and Model Extrapolation in the Evaluation of Clinical Center Performance
Overview
Affiliations
We consider statistical methods for benchmarking clinical centers based on a dichotomous outcome indicator. Borrowing ideas from the causal inference literature, we aim to reveal how the entire study population would have fared under the current care level of each center. To this end, we evaluate direct standardization based on fixed versus random center effects outcome models that incorporate patient-specific baseline covariates to adjust for differential case-mix. We explore fixed effects (FE) regression with Firth correction and normal mixed effects (ME) regression to maintain convergence in the presence of very small centers. Moreover, we study doubly robust FE regression to avoid outcome model extrapolation. Simulation studies show that shrinkage following standard ME modeling can result in substantial power loss relative to the considered alternatives, especially for small centers. Results are consistent with findings in the analysis of 30-day mortality risk following acute stroke across 90 centers in the Swedish Stroke Register.
Sinkovec H, Gall W, Heinze G Med Care. 2024; 62(11):748-756.
PMID: 39733232 PMC: 11462882. DOI: 10.1097/MLR.0000000000002057.
Limitations of the Inter-Unit Reliability: A Set of Practical Examples.
Hartman N, Shahinian V, Ashby V, Price K, He K Health Serv Outcomes Res Methodol. 2024; 24(2):156-169.
PMID: 39145149 PMC: 11323040. DOI: 10.1007/s10742-023-00307-0.
Hansen J, Ahern S, Earnest A BMJ Open. 2023; 13(7):e069130.
PMID: 37451708 PMC: 10351235. DOI: 10.1136/bmjopen-2022-069130.
Choi S, OGrady M, Cleland C, Knopf E, Hong S, DAunno T PLoS One. 2023; 18(6):e0286859.
PMID: 37294821 PMC: 10256218. DOI: 10.1371/journal.pone.0286859.
MEASURING PERFORMANCE FOR END-OF-LIFE CARE.
Haneuse S, Schrag D, Dominici F, Normand S, Lee K Ann Appl Stat. 2022; 16(3):1586-1607.
PMID: 36483542 PMC: 9728673. DOI: 10.1214/21-aoas1558.