Importance:
Evidence comparing the consequences of Choosing Wisely recommendations across health systems or with the consequences of recommendations plus policy change is lacking.
Objectives:
To compare changes in the use of 2 low-value laboratory tests after the release of Choosing Wisely recommendations across 3 health care jurisdictions and changes associated with a related policy change.
Design, Setting, And Participants:
This cross-sectional study was a population-based interrupted time series of adult patients (aged 18-64 years) who had primary care visits between January 1, 2010, and June 30, 2015, or established hypothyroidism between January 1, 2012, and June 30, 2015, across 3 health care delivery jurisdictions: Ontario, Canada; the US Veterans Health Administration; and the US employer-sponsored insurance market. Data analysis was performed from March 21, 2018, to October 31, 2019.
Exposures:
A December 2010 payment policy change that eliminated reimbursement of vitamin D screening in Ontario, Canada, and the subsequent release of Choosing Wisely recommendations against low-value use of vitamin D tests in February 2013 and triiodothyronine tests in October 2013 in the United States and both tests in October 2014 in Canada.
Main Outcomes And Measures:
Relative marginal effects (RMEs) comparing low-value testing rates after the release of Choosing Wisely recommendations with rates expected based on prerelease trends and the associated change in low-value vitamin D testing after the 2010 payment policy change in Ontario, Canada.
Results:
Of 54 223 448 total persons, 28 504 576 (52.6%) were female, with 17 895 458 persons (33.0%) aged 18 to 34 years, 11 101 985 (20.5%) aged 35 to 44 years, and 25 226 005 (46.5%) aged 45 to 64 years. The December 2010 policy eliminating reimbursement for low-value vitamin D screening in Ontario, Canada, was associated with a 92.7% (95% CI, 92.4%-93.0%) relative reduction in such screening. Corresponding Choosing Wisely recommendations were associated with smaller reductions: 4.5% (95% CI, 2.6%-6.3%) in Ontario, 13.8% (95% CI, 11.8%-15.9%) for US Veterans Health Administration, and 14.0% (95% CI, 12.8%-15.2%) for US employer-sponsored insurance. In contrast, low-value use of triiodothyronine testing did not change significantly in Ontario, Canada (RME, 0.3%; 95% CI, -1.4% to 2.0%) or the US Veterans Health Administration (RME, 0.7%; 95% CI, -4.7% to 6.4%) and increased (RME, 3.0%; 95% CI, 1.6%-4.4%) for US employer-sponsored insurance.
Conclusions And Relevance:
In this study, marginal reductions in the use of 2 low-value laboratory tests were associated with the release of related Choosing Wisely recommendations but a greater reduction in low-value vitamin D screening was associated with a previous payment policy change implemented in Ontario, Canada. These findings suggest that recommendations alone may be insufficient to significantly reduce use of low-value services and that pairing recommendations with policy changes may be more effective.
Citing Articles
Evidence-informed language: interpretation and impact on intentions to treat - results of an online survey of medical students and specialists in German-speaking countries.
Griebenow R, Schmidt J, Herrmann H, Benson S
BMJ Open. 2025; 15(2):e082907.
PMID: 39920073
PMC: 11808923.
DOI: 10.1136/bmjopen-2023-082907.
How Medical Students Benefit from Participating in a Longitudinal Resource Stewardship Medical Education Program (STARS): An International Descriptive Evaluation.
Silverstein W, Kerssens M, Vaassen S, Valencia V, van Mook W, Noben C
J Gen Intern Med. 2024; 40(1):146-152.
PMID: 39085581
PMC: 11780017.
DOI: 10.1007/s11606-024-08971-9.
Impact of Active Disinvestment on Decision-Making for Surgery in Patients With Subacromial Pain Syndrome: A Qualitative Semi-structured Interview Study Among Hospital Sales Managers and Orthopedic Surgeons.
Geurkink T, Marang-van de Mheen P, Nagels J, Poolman R, Nelissen R, van Bodegom-Vos L
Int J Health Policy Manag. 2024; 12:7710.
PMID: 38618816
PMC: 10590240.
DOI: 10.34172/ijhpm.2023.7710.
Identifying Strategies to Reduce Low-Value Preoperative Testing for Low-Risk Procedures: a Qualitative Study of Facilities with High or Recently Improved Levels of Testing.
Harris A, Finlay A, Hagedorn H, Manfredi L, Jones G, Kamal R
J Gen Intern Med. 2023; 38(14):3209-3215.
PMID: 37407767
PMC: 10651557.
DOI: 10.1007/s11606-023-08287-0.
A Policy Approach to Reducing Low-Value Device-Based Procedure Use.
Dhruva S, Bachhuber M, Shetty A, Guidry H, Guduguntla V, Redberg R
Milbank Q. 2022; 100(4):1006-1027.
PMID: 36573334
PMC: 9836248.
DOI: 10.1111/1468-0009.12595.
The impact of performance feedback reports on physician ordering behavior in the use of computed tomography pulmonary angiography (CTPA).
Salehi L, Jaskolka J, Yu H, Ossip M, Phalpher P, Valani R
Emerg Radiol. 2022; 30(1):63-69.
PMID: 36378395
PMC: 9664050.
DOI: 10.1007/s10140-022-02100-x.
Organizational influences on the use of low-value care in primary health care - a qualitative interview study with physicians in Sweden.
Lang G, Ingvarsson S, Hasson H, Nilsen P, Augustsson H
Scand J Prim Health Care. 2022; 40(4):426-437.
PMID: 36325746
PMC: 9848255.
DOI: 10.1080/02813432.2022.2139467.
Improving healthcare value: Lessons learned from the first decade of Choosing Wisely®.
Levinson W, Leis J
J Hosp Med. 2022; 18(1):78-81.
PMID: 36190815
PMC: 10092587.
DOI: 10.1002/jhm.12969.
Assessing patient, physician, and practice characteristics predicting the use of low-value services.
Shin E, Fleming C, Ghosh A, Javadi A, Powell R, Rich E
Health Serv Res. 2022; 57(6):1261-1273.
PMID: 36054345
PMC: 9643094.
DOI: 10.1111/1475-6773.14053.
Is Low-value Testing Before Low-risk Hand Surgery Associated With Increased Downstream Healthcare Use and Reimbursements? A National Claims Database Analysis.
Welch J, Zhuang T, Shapiro L, Harris A, Baker L, Kamal R
Clin Orthop Relat Res. 2022; 480(10):1851-1862.
PMID: 35608508
PMC: 9473771.
DOI: 10.1097/CORR.0000000000002255.
Diagnostic Value of Anti-Nuclear Antibodies: Results From Korean University-Affiliated Hospitals.
Kang S, Seo Y, Lee M, Kim H
J Korean Med Sci. 2022; 37(19):e159.
PMID: 35578590
PMC: 9110261.
DOI: 10.3346/jkms.2022.37.e159.
Inappropriate use of clinical practices in Canada: a systematic review.
Squires J, Cho-Young D, Aloisio L, Bell R, Bornstein S, Brien S
CMAJ. 2022; 194(8):E279-E296.
PMID: 35228321
PMC: 9053971.
DOI: 10.1503/cmaj.211416.
Does de-implementation of low-value care impact the patient-clinician relationship? A mixed methods study.
Rockwell M, Michaels K, Epling J
BMC Health Serv Res. 2022; 22(1):37.
PMID: 34991573
PMC: 8733793.
DOI: 10.1186/s12913-021-07345-9.
De-implementing low-value care in endocrinology.
Ospina N, Salloum R, Maraka S, Brito J
Endocrine. 2021; 73(2):292-300.
PMID: 33977312
PMC: 8476071.
DOI: 10.1007/s12020-021-02732-y.
Overuse of diagnostic testing in healthcare: a systematic review.
Muskens J, Kool R, Van Dulmen S, Westert G
BMJ Qual Saf. 2021; 31(1):54-63.
PMID: 33972387
PMC: 8685650.
DOI: 10.1136/bmjqs-2020-012576.
Potentially inappropriate proton-pump inhibitor prescription in the general population: a claims-based retrospective time trend analysis.
Muheim L, Signorell A, Markun S, Chmiel C, Neuner-Jehle S, Blozik E
Therap Adv Gastroenterol. 2021; 14:1756284821998928.
PMID: 33948109
PMC: 8053831.
DOI: 10.1177/1756284821998928.
Trends in Low-Value Health Service Use and Spending in the US Medicare Fee-for-Service Program, 2014-2018.
Mafi J, Reid R, Baseman L, Hickey S, Totten M, Agniel D
JAMA Netw Open. 2021; 4(2):e2037328.
PMID: 33591365
PMC: 7887655.
DOI: 10.1001/jamanetworkopen.2020.37328.
[The problem of medical overuse : Finding a definition and solutions].
Gamstatter T
Internist (Berl). 2021; 62(4):343-353.
PMID: 33580822
DOI: 10.1007/s00108-021-00957-7.
Low-Value Diagnostic Imaging in Children with Medicaid.
Marin J, Hollander M, Ray K, Donohue J, Cole E
J Pediatr. 2021; 235:253-263.e14.
PMID: 33556364
PMC: 8316256.
DOI: 10.1016/j.jpeds.2021.02.003.
Reducing redundant creatine kinase testing in cardiac injury.
Raza S, Amaral A, Pang J, Moussa F, Shelton D, Notario L
BMJ Open Qual. 2020; 9(4).
PMID: 33376105
PMC: 7778776.
DOI: 10.1136/bmjoq-2020-001182.