Application of Validity Theory and Methodology to Patient-reported Outcome Measures (PROMs): Building an Argument for Validity

Overview

Journal Qual Life Res

Specialties Pharmacology
Rehabilitation Medicine

Date 2018 Feb 22

PMID 29464456

Citations 52

Authors

Melanie Hawkins

Gerald R Elsworth

Richard H Osborne

Affiliations

Soon will be listed here.

Abstract

Background: Data from subjective patient-reported outcome measures (PROMs) are now being used in the health sector to make or support decisions about individuals, groups and populations. Contemporary validity theorists define validity not as a statistical property of the test but as the extent to which empirical evidence supports the interpretation of test scores for an intended use. However, validity testing theory and methodology are rarely evident in the PROM validation literature. Application of this theory and methodology would provide structure for comprehensive validation planning to support improved PROM development and sound arguments for the validity of PROM score interpretation and use in each new context.

Objective: This paper proposes the application of contemporary validity theory and methodology to PROM validity testing.

Illustrative Example: The validity testing principles will be applied to a hypothetical case study with a focus on the interpretation and use of scores from a translated PROM that measures health literacy (the Health Literacy Questionnaire or HLQ).

Discussion: Although robust psychometric properties of a PROM are a pre-condition to its use, a PROM's validity lies in the sound argument that a network of empirical evidence supports the intended interpretation and use of PROM scores for decision making in a particular context. The health sector is yet to apply contemporary theory and methodology to PROM development and validation. The theoretical and methodological processes in this paper are offered as an advancement of the theory and practice of PROM validity testing in the health sector.

Citing Articles

A worldwide itinerary of research ethics in science for a better social responsibility and justice: a bibliometric analysis and review.

Adjovi I Front Res Metr Anal. 2025; 10:1504937.

PMID: 40012693 PMC: 11850331. DOI: 10.3389/frma.2025.1504937.

Patient-reported outcome measures for paediatric gender-affirming care: A systematic review.

Jackman L, Chan C, Jacklin C, Deck E, Lee A, Stepney M Paediatr Child Health. 2025; 29(8):514-527.

PMID: 39990034 PMC: 11840252. DOI: 10.1093/pch/pxae019.

Health Literacy and Self-Efficacy in Parents of Toddlers-A Cross-Sectional Study.

Soreide R, Larsen M, Wahl A, Tschamper M, Urstad K Nurs Open. 2025; 12(2):e70078.

PMID: 39962761 PMC: 11832592. DOI: 10.1002/nop2.70078.

[Measuring health literacy: methods and tools for assessing general health literacy in adults].

Griebler R, Link T, Schutze D, Strassmayr C Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2025; 68(3):247-254.

PMID: 39945780 PMC: 11868340. DOI: 10.1007/s00103-025-04010-y.

Equity in cancer care: mixed methods clinical utility analysis of the Nursing Equity Assessment Tool (NEAT) to identify disadvantage in newly diagnosed cancer patients.

Chung H, Crone E, Gough K, Hyatt A, Milne D, Krishnasamy M Support Care Cancer. 2024; 33(1):60.

PMID: 39738715 PMC: 11683018. DOI: 10.1007/s00520-024-09094-x.

References

Aaronson N, Alonso J, Burnam A, Lohr K, Patrick D, Perrin E . Assessing health status and quality-of-life instruments: attributes and review criteria. Qual Life Res. 2002; 11(3):193-205. DOI: 10.1023/a:1015291021312. View

Cook D, Brydges R, Ginsburg S, Hatala R . A contemporary approach to validity arguments: a practical guide to Kane's framework. Med Educ. 2015; 49(6):560-75. DOI: 10.1111/medu.12678. View

McClimans L . A theoretical framework for patient-reported outcome measures. Theor Med Bioeth. 2010; 31(3):225-40. DOI: 10.1007/s11017-010-9142-0. View

Osborne R, Elsworth G, Whitfield K . The Health Education Impact Questionnaire (heiQ): an outcomes and evaluation measure for patient education and self-management interventions for people with chronic conditions. Patient Educ Couns. 2007; 66(2):192-201. DOI: 10.1016/j.pec.2006.12.002. View

Morris R, Soh S, Hill K, Buchbinder R, Lowthian J, Redfern J . Measurement properties of the Health Literacy Questionnaire (HLQ) among older adults who present to the emergency department after a fall: a Rasch analysis. BMC Health Serv Res. 2017; 17(1):605. PMC: 5575841. DOI: 10.1186/s12913-017-2520-9. View

Smith B, Tang K, Nutbeam D . WHO Health Promotion Glossary: new terms. Health Promot Int. 2006; 21(4):340-5. DOI: 10.1093/heapro/dal033. View

Friis K, Lasgaard M, Osborne R, Maindal H . Gaps in understanding health and engagement with healthcare providers across common long-term conditions: a population survey of health literacy in 29,473 Danish citizens. BMJ Open. 2016; 6(1):e009627. PMC: 4735217. DOI: 10.1136/bmjopen-2015-009627. View

Osborne R, Norquist J, Elsworth G, Busija L, Mehta V, Herring T . Development and validation of the Influenza Intensity and Impact Questionnaire (FluiiQ™). Value Health. 2011; 14(5):687-99. DOI: 10.1016/j.jval.2010.12.005. View

Reeve B, Wyrwich K, Wu A, Velikova G, Terwee C, Snyder C . ISOQOL recommends minimum standards for patient-reported outcome measures used in patient-centered outcomes and comparative effectiveness research. Qual Life Res. 2013; 22(8):1889-905. DOI: 10.1007/s11136-012-0344-y. View

10.

Nolte S, Osborne R, Dwinger S, Elsworth G, Conrad M, Rose M . German translation, cultural adaptation, and validation of the Health Literacy Questionnaire (HLQ). PLoS One. 2017; 12(2):e0172340. PMC: 5325258. DOI: 10.1371/journal.pone.0172340. View

11.

Hawkins M, Gill S, Batterham R, Elsworth G, Osborne R . The Health Literacy Questionnaire (HLQ) at the patient-clinician interface: a qualitative study of what patients and clinicians mean by their HLQ scores. BMC Health Serv Res. 2017; 17(1):309. PMC: 5408483. DOI: 10.1186/s12913-017-2254-8. View

12.

Messick S . PERSONALITY MEASUREMENT AND THE ETHICS OF ASSESSMENT. Am Psychol. 1965; 20:136-42. DOI: 10.1037/h0021712. View

13.

Kolarcik P, Cepova E, Geckova A, Elsworth G, Batterham R, Osborne R . Structural properties and psychometric improvements of the Health Literacy Questionnaire in a Slovak population. Int J Public Health. 2017; 62(5):591-604. DOI: 10.1007/s00038-017-0945-x. View

14.

Beauchamp A, Batterham R, Dodson S, Astbury B, Elsworth G, McPhee C . Systematic development and implementation of interventions to OPtimise Health Literacy and Access (Ophelia). BMC Public Health. 2017; 17(1):230. PMC: 5335493. DOI: 10.1186/s12889-017-4147-5. View

15.

Wild D, Grove A, Martin M, Eremenco S, McElroy S, Verjee-Lorenz A . Principles of Good Practice for the Translation and Cultural Adaptation Process for Patient-Reported Outcomes (PRO) Measures: report of the ISPOR Task Force for Translation and Cultural Adaptation. Value Health. 2005; 8(2):94-104. DOI: 10.1111/j.1524-4733.2005.04054.x. View

16.

Beauchamp A, Buchbinder R, Dodson S, Batterham R, Elsworth G, McPhee C . Distribution of health literacy strengths and weaknesses across socio-demographic groups: a cross-sectional survey using the Health Literacy Questionnaire (HLQ). BMC Public Health. 2015; 15:678. PMC: 4508810. DOI: 10.1186/s12889-015-2056-z. View

17.

Buchbinder R, Batterham R, Elsworth G, Dionne C, Irvin E, Osborne R . A validity-driven approach to the understanding of the personal and societal burden of low back pain: development of a conceptual and measurement model. Arthritis Res Ther. 2011; 13(5):R152. PMC: 3308082. DOI: 10.1186/ar3468. View

18.

Rabin R, Gudex C, Selai C, Herdman M . From translation to version management: a history and review of methods for the cultural adaptation of the EuroQol five-dimensional questionnaire. Value Health. 2014; 17(1):70-6. DOI: 10.1016/j.jval.2013.10.006. View

19.

Epstein J, Santo R, Guillemin F . A review of guidelines for cross-cultural adaptation of questionnaires could not bring out a consensus. J Clin Epidemiol. 2015; 68(4):435-41. DOI: 10.1016/j.jclinepi.2014.11.021. View

20.

Busija L, Buchbinder R, Osborne R . Development and preliminary evaluation of the OsteoArthritis Questionnaire (OA-Quest): a psychometric study. Osteoarthritis Cartilage. 2016; 24(8):1357-66. DOI: 10.1016/j.joca.2016.03.014. View