Evidence for Publicly Reported Quality Indicators in Residential Long-term Care: a Systematic Review

Overview

Journal BMC Health Serv Res

Publisher Biomed Central

Specialty Health Services

Date 2022 Nov 24

PMID 36424603

Authors

Magdalena Osinska

Lauriane Favez

Franziska Zuniga

Affiliations

Soon will be listed here.

Abstract

Background: An increasing number of countries are using or planning to use quality indicators (QIs) in residential long-term care. Knowledge regarding the current state of evidence on usage and methodological soundness of publicly reported clinical indicators of quality in nursing homes is needed. The study aimed to answer the questions: 1) Which health-related QIs for residents in long-term care are currently publicly reported internationally? and 2) What is the methodological quality of these indicators?

Methods: A systematic search was conducted in the electronic databases PubMed, CINAHL and Embase in October 2019 and last updated on August 31st, 2022. Grey literature was also searched. We used the Appraisal of Indicators through Research and Evaluation (AIRE) instrument for the methodological quality assessment of the identified QIs.

Results: Of 23'344 identified records, 22 articles and one report describing 21 studies met the inclusion criteria. Additionally, we found 17 websites publishing information on QIs. We identified eight countries publicly reporting a total of 99 health-related QIs covering 31 themes. Each country used between six and 31 QIs. The most frequently reported indicators were pressure ulcers, falls, physical restraints, and weight loss. For most QI sets, we found basic information regarding e.g., purpose, definition of the indicators, risk-adjustment, and stakeholders' involvement in QIs' selection. Little up to date information was found regarding validity, reliability and discriminative power of the QIs. Only the Australian indicator set reached high methodological quality, defined as scores of 50% or higher in all four AIRE instrument domains.

Conclusions: Little information is available to the public and researchers for the evaluation of a large number of publicly reported QIs in the residential long-term care sector. Better reporting is needed on the methodological quality of QIs in this setting, whether they are meant for internal quality improvement or provider comparison.

Citing Articles

Improving Data-Informed Care in New Brunswick Long-Term Care Homes: A Qualitative Study on an Educational Intervention for interRAI Coordinators.

MacLean R, Durepos P, Keeping-Burke L, McCloskey R Healthcare (Basel). 2025; 12(24.

PMID: 39766019 PMC: 11727779. DOI: 10.3390/healthcare12242592.

The impact of patient-facility language discordance on potentially inappropriate prescribing of antipsychotics in long-term care home in Ontario, Canada: a retrospective population health cohort study.

Reaume M, Peixoto C, Pugliese M, Tanuseputro P, Batista R, Kendall C BMC Geriatr. 2024; 24(1):889.

PMID: 39468456 PMC: 11514756. DOI: 10.1186/s12877-024-05446-8.

Mapping Quality Indicators to Assess Older Adult Health and Care in Community-, Continuing-, and Acute-Care Settings: A Systematic Review of Reviews and Guidelines.

Karimi-Dehkordi M, Hanson H, Kennedy M, Wagg A Healthcare (Basel). 2024; 12(14).

PMID: 39057540 PMC: 11276513. DOI: 10.3390/healthcare12141397.

Longitudinal cohort study of discrepancies between prescribed and administered polypharmacy rates: implications for National Aged Care Quality Indicator Programs.

Wabe N, Urwin R, Seaman K, Westbrook J BMJ Qual Saf. 2024; 33(12):780-789.

PMID: 39013597 PMC: 11671870. DOI: 10.1136/bmjqs-2023-017042.

Key performance indicators for pharmaceutical services: A systematic review.

de Souza J, Fernandes B, Rotta I, Visacri M, Lima T Explor Res Clin Soc Pharm. 2024; 14:100441.

PMID: 38665264 PMC: 11044031. DOI: 10.1016/j.rcsop.2024.100441.

References

Zimmerman D . Improving nursing home quality of care through outcomes data: the MDS quality indicators. Int J Geriatr Psychiatry. 2003; 18(3):250-7. DOI: 10.1002/gps.820. View

Dequanter S, Buyl R, Fobelets M . Quality indicators for community dementia care: a systematic review. Eur J Public Health. 2020; 30(5):879-885. DOI: 10.1093/eurpub/ckaa096. View

Hill-Westmoreland E, Gruber-Baldini A . Falls documentation in nursing homes: agreement between the minimum data set and chart abstractions of medical and nursing documentation. J Am Geriatr Soc. 2005; 53(2):268-73. DOI: 10.1111/j.1532-5415.2005.53113.x. View

Favez L, Zuniga F, Sharma N, Blatter C, Simon M . Assessing Nursing Homes Quality Indicators' Between-Provider Variability and Reliability: A Cross-Sectional Study Using ICCs and Rankability. Int J Environ Res Public Health. 2020; 17(24). PMC: 7764139. DOI: 10.3390/ijerph17249249. View

Schang L, Blotenberg I, Boywitt D . What makes a good quality indicator set? A systematic review of criteria. Int J Qual Health Care. 2021; 33(3). PMC: 8325455. DOI: 10.1093/intqhc/mzab107. View

Kieft R, Stalpers D, Jansen A, Francke A, Delnoij D . The methodological quality of nurse-sensitive indicators in Dutch hospitals: A descriptive exploratory research study. Health Policy. 2018; 122(7):755-764. DOI: 10.1016/j.healthpol.2018.05.015. View

Karon S, Sainfort F, Zimmerman D . Stability of nursing home quality indicators over time. Med Care. 1999; 37(6):570-9. DOI: 10.1097/00005650-199906000-00006. View

Jones R, Hirdes J, Poss J, Kelly M, Berg K, Fries B . Adjustment of nursing home quality indicators. BMC Health Serv Res. 2010; 10:96. PMC: 2881673. DOI: 10.1186/1472-6963-10-96. View

Wu N, Miller S, Lapane K, Roy J, Mor V . The quality of the quality indicator of pain derived from the minimum data set. Health Serv Res. 2005; 40(4):1197-216. PMC: 1361186. DOI: 10.1111/j.1475-6773.2005.00400.x. View

10.

Wagner A, Schaffert R, Mockli N, Zuniga F, Dratva J . Home care quality indicators based on the Resident Assessment Instrument-Home Care (RAI-HC): a systematic review. BMC Health Serv Res. 2020; 20(1):366. PMC: 7191714. DOI: 10.1186/s12913-020-05238-x. View

11.

Berg K, Mor V, Morris J, Murphy K, Moore T, Harris Y . Identification and evaluation of existing nursing homes quality indicators. Health Care Financ Rev. 2002; 23(4):19-36. PMC: 4194753. View

12.

Schnelle J, Cadogan M, Yoshii J, Al-Samarrai N, Osterweil D, Bates-Jensen B . The minimum data set urinary incontinence quality indicators: do they reflect differences in care processes related to incontinence?. Med Care. 2003; 41(8):909-22. DOI: 10.1097/00005650-200308000-00005. View

13.

Mor V, Angelelli J, Jones R, Roy J, Moore T, Morris J . Inter-rater reliability of nursing home quality indicators in the U.S. BMC Health Serv Res. 2003; 3(1):20. PMC: 280691. DOI: 10.1186/1472-6963-3-20. View

14.

Simmons S, Garcia E, Cadogan M, Al-Samarrai N, Levy-Storms L, Osterweil D . The minimum data set weight-loss quality indicator: does it reflect differences in care processes related to weight loss?. J Am Geriatr Soc. 2003; 51(10):1410-8. DOI: 10.1046/j.1532-5415.2003.51459.x. View

15.

Sales A, Bostrom A, Bucknall T, Draper K, Fraser K, Schalm C . The use of data for process and quality improvement in long term care and home care: a systematic review of the literature. J Am Med Dir Assoc. 2011; 13(2):103-13. DOI: 10.1016/j.jamda.2011.01.004. View

16.

Poldrugovac M, Padget M, Schoonhoven L, Thompson N, Klazinga N, Kringos D . International comparison of pressure ulcer measures in long-term care facilities: Assessing the methodological robustness of 4 approaches to point prevalence measurement. J Tissue Viability. 2021; 30(4):517-526. PMC: 11000144. DOI: 10.1016/j.jtv.2021.01.007. View

17.

Schnelle J, Bates-Jensen B, Levy-Storms L, Grbic V, Yoshii J, Cadogan M . The minimum data set prevalence of restraint quality indicator: does it reflect differences in care?. Gerontologist. 2004; 44(2):245-55. DOI: 10.1093/geront/44.2.245. View

18.

Righolt A, Sidorenkov G, Faggion Jr C, Listl S, Duijster D . Quality measures for dental care: A systematic review. Community Dent Oral Epidemiol. 2018; 47(1):12-23. PMC: 7379624. DOI: 10.1111/cdoe.12429. View

19.

Hutchinson A, Milke D, Maisey S, Johnson C, Squires J, Teare G . The Resident Assessment Instrument-Minimum Data Set 2.0 quality indicators: a systematic review. BMC Health Serv Res. 2010; 10:166. PMC: 2914032. DOI: 10.1186/1472-6963-10-166. View

20.

Siegel E, Backman A, Cai Y, Goodman C, Ocho O, Wei S . Understanding Contextual Differences in Residential LTC Provision for Cross-National Research: Identifying Internationally Relevant CDEs. Gerontol Geriatr Med. 2019; 5:2333721419840591. PMC: 6598333. DOI: 10.1177/2333721419840591. View