Reliability of the InterRAI Suite of Assessment Instruments: a 12-country Study of an Integrated Health Information System

Overview

Journal BMC Health Serv Res

Publisher Biomed Central

Specialty Health Services

Date 2009 Jan 1

PMID 19115991

Citations 232

Authors

John P Hirdes

Gunnar Ljunggren

John N Morris

Dinnus H M Frijters

Harriet Finne Soveri

Len Gray

Magnus Bjorkgren

Reudi Gilgen

Affiliations

Soon will be listed here.

Abstract

Background: A multi-domain suite of instruments has been developed by the interRAI research collaborative to support assessment and care planning in mental health, aged care and disability services. Each assessment instrument comprises items common to other instruments and specialized items exclusive to that instrument. This study examined the reliability of the items from five instruments supporting home care, long term care, mental health, palliative care and post-acute care.

Methods: Paired assessments on 783 individuals across 12 nations were completed within 72 hours of each other by trained assessors who were blinded to the others' assessment. Reliability was tested using weighted kappa coefficients.

Results: The overall kappa mean value for 161 items which are common to 2 or more instruments was 0.75. The kappa mean value for specialized items varied among instruments from 0.63 to 0.73. Over 60% of items scored greater than 0.70.

Conclusion: The vast majority of items exceeded standard cut-offs for acceptable reliability, with only modest variation among instruments. The overall performance of these instruments showed that the interRAI suite has substantial reliability according to conventional cut-offs for interpreting the kappa statistic. The results indicate that interRAI items retain reliability when used across care settings, paving the way for cross domain application of the instruments as part of an integrated health information system.

Citing Articles

Health, functioning and social engagement among older people living in long-term care facilities during the COVID-19 lockdown in Finland: a register-based cohort study.

Edgren J, Hasa J, Aaltonen M BMC Public Health. 2025; 25(1):929.

PMID: 40057682 PMC: 11890530. DOI: 10.1186/s12889-025-22032-8.

Validation of a composite outcome measure for inpatient psychiatry using scales from the interRAI-MH.

Barbaree H, Perlman C, Ham E, Brown G, Hirdes J Front Psychiatry. 2025; 16:1486734.

PMID: 39980981 PMC: 11839811. DOI: 10.3389/fpsyt.2025.1486734.

Development and validation of a brief assessment of normative health and health-related social needs using the Simple Segmentation Tool.

Matchar D, Vashishtha R, Jing X, Sivapragasam N, Sim R, Chong J BMC Health Serv Res. 2025; 25(1):230.

PMID: 39934828 PMC: 11818109. DOI: 10.1186/s12913-025-12364-x.

Piloting a minimum data set for older people living in care homes in England: a developmental study.

Gordon A, Rand S, Crellin E, Allan S, Tracey F, De Corte K Age Ageing. 2025; 54(1.

PMID: 39812411 PMC: 11733825. DOI: 10.1093/ageing/afaf001.

School Closures on Bullying Experiences of Treatment-Seeking Children and Youth: The Influence of the COVID-19 Pandemic Within Ontario, Canada.

Stewart S, Withers A, Poss J Int J Environ Res Public Health. 2025; 21(12.

PMID: 39767512 PMC: 11675720. DOI: 10.3390/ijerph21121673.

References

Mor V, Angelelli J, Jones R, Roy J, Moore T, Morris J . Inter-rater reliability of nursing home quality indicators in the U.S. BMC Health Serv Res. 2003; 3(1):20. PMC: 280691. DOI: 10.1186/1472-6963-3-20. View

Morris J, Jones R, Fries B, Hirdes J . Convergent validity of minimum data set-based performance quality indicators in postacute care settings. Am J Med Qual. 2004; 19(6):242-7. DOI: 10.1177/106286060401900603. View

Landi F, Tua E, Onder G, Carrara B, Sgadari A, Rinaldi C . Minimum data set for home care: a valid instrument to assess frail older people living in the community. Med Care. 2001; 38(12):1184-90. DOI: 10.1097/00005650-200012000-00005. View

Jonsson P, Finne-Soveri H, Jensdottir A, Ljunggren G, Bucht G, Grue E . Co-morbidity and functional limitation in older patients underreported in medical records in Nordic Acute Care Hospitals when compared with the MDS-AC instrument. Age Ageing. 2006; 35(4):434-8. DOI: 10.1093/ageing/afj060. View

Kuziemsky C, Lau F . A comparative analysis of computer based hospice palliative care datasets in Canada. BMC Palliat Care. 2008; 7:6. PMC: 2396153. DOI: 10.1186/1472-684X-7-6. View

Morris J, Nonemaker S, Murphy K, Hawes C, Fries B, Mor V . A commitment to change: revision of HCFA's RAI. J Am Geriatr Soc. 1997; 45(8):1011-6. DOI: 10.1111/j.1532-5415.1997.tb02974.x. View

Carpenter G, Teare G, Steel K, Berg K, Murphy K, BJORNSON J . A new assessment for elders admitted to acute care: reliability of the MDS-AC. Aging (Milano). 2001; 13(4):316-30. View

Fries B, Schroll M, Hawes C, Gilgen R, Jonsson P, Park P . Approaching cross-national comparisons of nursing home residents. Age Ageing. 1998; 26 Suppl 2:13-8. DOI: 10.1093/ageing/26.suppl_2.13. View

Koehler M, Rabinowitz T, Hirdes J, Stones M, Carpenter G, Fries B . Measuring depression in nursing home residents with the MDS and GDS: an observational psychometric study. BMC Geriatr. 2005; 5:1. PMC: 546185. DOI: 10.1186/1471-2318-5-1. View

10.

Hawes C, Morris J, Phillips C, Mor V, Fries B, Nonemaker S . Reliability estimates for the Minimum Data Set for nursing home resident assessment and care screening (MDS). Gerontologist. 1995; 35(2):172-8. DOI: 10.1093/geront/35.2.172. View

11.

Morris J, Hawes C, Fries B, Phillips C, Mor V, Katz S . Designing the national resident assessment instrument for nursing homes. Gerontologist. 1990; 30(3):293-307. DOI: 10.1093/geront/30.3.293. View

12.

Hirdes J, Smith T, Rabinowitz T, Yamauchi K, Perez E, Telegdi N . The Resident Assessment Instrument-Mental Health (RAI-MH): inter-rater reliability and convergent validity. J Behav Health Serv Res. 2002; 29(4):419-32. DOI: 10.1007/BF02287348. View

13.

Morris J, Fries B, Morris S . Scaling ADLs within the MDS. J Gerontol A Biol Sci Med Sci. 2000; 54(11):M546-53. DOI: 10.1093/gerona/54.11.m546. View

14.

Gindin J, Walter-Ginzburg A, Geitzen M, Epstein S, Levi S, Landi F . Predictors of rehabilitation outcomes: a comparison of Israeli and Italian geriatric post-acute care (PAC) facilities using the minimum data set (MDS). J Am Med Dir Assoc. 2007; 8(4):233-42. DOI: 10.1016/j.jamda.2006.12.032. View

15.

Hawes C, Fries B, James M, Guihan M . Prospects and pitfalls: use of the RAI-HC assessment by the Department of Veterans Affairs for home care clients. Gerontologist. 2007; 47(3):378-87. DOI: 10.1093/geront/47.3.378. View

16.

Carpenter I, Gambassi G, Topinkova E, Schroll M, Finne-Soveri H, Henrard J . Community care in Europe. The Aged in Home Care project (AdHOC). Aging Clin Exp Res. 2004; 16(4):259-69. DOI: 10.1007/BF03324550. View

17.

Gray L, Bernabei R, Berg K, Finne-Soveri H, Fries B, Hirdes J . Standardizing assessment of elderly people in acute care: the interRAI Acute Care instrument. J Am Geriatr Soc. 2008; 56(3):536-41. DOI: 10.1111/j.1532-5415.2007.01590.x. View

18.

Landis J, Koch G . The measurement of observer agreement for categorical data. Biometrics. 1977; 33(1):159-74. View

19.

Fries B, Morris J, Bernabei R, Finne-Soveri H, Hirdes J . Rethinking the Resident Assessment Protocols. J Am Geriatr Soc. 2007; 55(7):1139-40. DOI: 10.1111/j.1532-5415.2007.01207.x. View

20.

Morris J, Fries B, Mehr D, Hawes C, Phillips C, Mor V . MDS Cognitive Performance Scale. J Gerontol. 1994; 49(4):M174-82. DOI: 10.1093/geronj/49.4.m174. View