Validity and Reliability of Patient-reported Outcomes Measurement Information System Instruments in Osteoarthritis

Overview

Journal Arthritis Care Res (Hoboken)

Specialty Rheumatology

Date 2013 Apr 18

PMID 23592494

Citations 62

Authors

Joan E Broderick

Stefan Schneider

Doerte U Junghaenel

Joseph E Schwartz

Arthur A Stone

Affiliations

Soon will be listed here.

Abstract

Objective: Evaluation of known-group validity, ecological validity, and test-retest reliability of 4 domain instruments from the Patient-Reported Outcomes Measurement Information System (PROMIS) in osteoarthritis (OA) patients.

Methods: We recruited an OA sample and a comparison general population (GP) sample through an internet survey panel. Pain intensity, pain interference, physical functioning, and fatigue were assessed for 4 consecutive weeks with PROMIS short forms on a daily basis and compared with same-domain Computer Adaptive Testing (CAT) instruments that use a 7-day recall. Known-group validity (comparison of OA and GP), ecological validity (comparison of aggregated daily measures with CAT instruments), and test-retest reliability were evaluated.

Results: The recruited samples matched the demographic characteristics (age, sex, race, and ethnicity) of the US sample for arthritis and the 2009 Census for the GP. Compliance with repeated measurements was excellent at >95%. Known-group validity for CATs was demonstrated with large effect sizes (pain intensity 1.42, pain interference 1.25, and fatigue 0.85). Ecological validity was also established through high correlations between aggregated daily measures and weekly CATs (≥0.86). Test-retest validity (7-day) was very good (≥0.80).

Conclusion: PROMIS CAT instruments demonstrated known-group and ecological validity in a comparison of OA patients with a GP sample. Adequate test-retest reliability was also observed. These data provide encouraging initial data on the utility of these PROMIS instruments for clinical and research outcomes in OA patients.

Citing Articles

A protocol for a wait list control trial of an intervention to improve pain and depressive symptoms among middle-aged and older women living with disabilities.

Taylor J, Clair C, Atkins S, Wang C, Booth A, Reid M Contemp Clin Trials. 2025; 150:107826.

PMID: 39884648 PMC: 11892009. DOI: 10.1016/j.cct.2025.107826.

Patient-reported outcome for physical function in idiopathic inflammatory myopathy.

Keret S, Lomanto Silva R, Chandra T, Sharma A, Moghadam-Kia S, Oddis C Rheumatology (Oxford). 2024; 64(2):763-770.

PMID: 38321360 PMC: 11781581. DOI: 10.1093/rheumatology/keae091.

Feasibility of a community-based structured exercise program for persons with spinal cord injury.

Morgan K, Taylor K, Desai R, Walker K, Tucker S, Walker C J Spinal Cord Med. 2024; 48(2):338-350.

PMID: 38240662 PMC: 11864005. DOI: 10.1080/10790268.2023.2293327.

Feasibility of DNA Methylation Age as a Biomarker of Symptoms and Resilience among Cancer Survivors with Multiple Chronic Conditions.

Lukkahatai N, Park J, Jia H, Martin D, Li J, Sheng J Biomedicines. 2023; 11(11).

PMID: 38002076 PMC: 10669866. DOI: 10.3390/biomedicines11113076.

Association of cannabis use with patient-reported pain measures among adults with chronic pain in US states with medical cannabis programs.

Bicket M, Stone E, McGinty E Reg Anesth Pain Med. 2023; 49(9):642-649.

PMID: 37923347 PMC: 11065967. DOI: 10.1136/rapm-2023-104833.

References

Stone A, Schwartz J, Broderick J, Shiffman S . Variability of momentary pain predicts recall of weekly pain: a consequence of the peak (or salience) memory heuristic. Pers Soc Psychol Bull. 2005; 31(10):1340-6. DOI: 10.1177/0146167205275615. View

Schneider S, Junghaenel D, Keefe F, Schwartz J, Stone A, Broderick J . Individual differences in the day-to-day variability of pain, fatigue, and well-being in patients with rheumatic disease: associations with psychological variables. Pain. 2012; 153(4):813-822. PMC: 3307888. DOI: 10.1016/j.pain.2012.01.001. View

Meenan R, Mason J, Anderson J, Guccione A, Kazis L . AIMS2. The content and properties of a revised and expanded Arthritis Impact Measurement Scales Health Status Questionnaire. Arthritis Rheum. 1992; 35(1):1-10. DOI: 10.1002/art.1780350102. View

Stone A, Broderick J, Shiffman S, Schwartz J . Understanding recall of weekly pain from a momentary assessment perspective: absolute agreement, between- and within-person consistency, and judged change in weekly pain. Pain. 2004; 107(1-2):61-9. DOI: 10.1016/j.pain.2003.09.020. View

Schafer J, Olsen M . Multiple Imputation for Multivariate Missing-Data Problems: A Data Analyst's Perspective. Multivariate Behav Res. 2016; 33(4):545-71. DOI: 10.1207/s15327906mbr3304_5. View

Choi S, Swartz R . Comparison of CAT Item Selection Criteria for Polytomous Items. Appl Psychol Meas. 2009; 33(6):419-440. PMC: 2791416. DOI: 10.1177/0146621608327801. View

Bolen J, Schieb L, Hootman J, Helmick C, Theis K, Murphy L . Differences in the prevalence and severity of arthritis among racial/ethnic groups in the United States, National Health Interview Survey, 2002, 2003, and 2006. Prev Chronic Dis. 2010; 7(3):A64. PMC: 2879996. View

Liu H, Cella D, Gershon R, Shen J, Morales L, Riley W . Representativeness of the Patient-Reported Outcomes Measurement Information System Internet panel. J Clin Epidemiol. 2010; 63(11):1169-78. PMC: 2943555. DOI: 10.1016/j.jclinepi.2009.11.021. View

Bellamy N, Kirwan J, Boers M, Brooks P, Strand V, Tugwell P . Recommendations for a core set of outcome measures for future phase III clinical trials in knee, hip, and hand osteoarthritis. Consensus development at OMERACT III. J Rheumatol. 1997; 24(4):799-802. View

10.

Graham J . Missing data analysis: making it work in the real world. Annu Rev Psychol. 2008; 60:549-76. DOI: 10.1146/annurev.psych.58.110405.085530. View

11.

Fries J, Krishnan E, Rose M, Lingala B, Bruce B . Improved responsiveness and reduced sample size requirements of PROMIS physical function scales with item response theory. Arthritis Res Ther. 2011; 13(5):R147. PMC: 3308075. DOI: 10.1186/ar3461. View

12.

Choi S, Reise S, Pilkonis P, Hays R, Cella D . Efficiency of static and computer adaptive short forms compared to full-length measures of depressive symptoms. Qual Life Res. 2009; 19(1):125-36. PMC: 2832176. DOI: 10.1007/s11136-009-9560-5. View

13.

Dworkin R, Turk D, Farrar J, Haythornthwaite J, Jensen M, Katz N . Core outcome measures for chronic pain clinical trials: IMMPACT recommendations. Pain. 2004; 113(1-2):9-19. DOI: 10.1016/j.pain.2004.09.012. View

14.

Redelmeier D, Kahneman D . Patients' memories of painful medical treatments: real-time and retrospective evaluations of two minimally invasive procedures. Pain. 1996; 66(1):3-8. DOI: 10.1016/0304-3959(96)02994-6. View

15.

Amtmann D, Cook K, Jensen M, Chen W, Choi S, Revicki D . Development of a PROMIS item bank to measure pain interference. Pain. 2010; 150(1):173-182. PMC: 2916053. DOI: 10.1016/j.pain.2010.04.025. View

16.

Cella D, Gershon R, Lai J, Choi S . The future of outcomes measurement: item banking, tailored short-forms, and computerized adaptive assessment. Qual Life Res. 2007; 16 Suppl 1:133-41. DOI: 10.1007/s11136-007-9204-6. View

17.

Keller S, Bayliss M, Ware Jr J, Hsu M, Damiano A, Goss T . Comparison of responses to SF-36 Health Survey questions with one-week and four-week recall periods. Health Serv Res. 1997; 32(3):367-84. PMC: 1070196. View

18.

Khanna D, Krishnan E, Morgan DeWitt E, Khanna P, Spiegel B, Hays R . The future of measuring patient-reported outcomes in rheumatology: Patient-Reported Outcomes Measurement Information System (PROMIS). Arthritis Care Res (Hoboken). 2012; 63 Suppl 11:S486-90. PMC: 3302685. DOI: 10.1002/acr.20581. View

19.

Broderick J, Schwartz J, Schneider S, Stone A . Can End-of-day reports replace momentary assessment of pain and fatigue?. J Pain. 2008; 10(3):274-81. PMC: 2757263. DOI: 10.1016/j.jpain.2008.09.003. View

20.

Bombard J, Powell K, Martin L, Helmick C, Wilson W . Validity and reliability of self-reported arthritis: Georgia senior centers, 2000-2001. Am J Prev Med. 2005; 28(3):251-8. DOI: 10.1016/j.amepre.2004.12.004. View