Variation in the Readability of Items Within Surveys

Overview

Journal Am J Med Qual

Date 2006 Jan 13

PMID 16401705

Citations 31

Authors

Jose L Calderon

Leo S Morales

Honghu Liu

Ron D Hays

Affiliations

Soon will be listed here.

Abstract

The objective of this study was to estimate the variation in the readability of survey items within 2 widely used health-related quality-of-life surveys: the National Eye Institute Visual Functioning Questionnaire-25 (VFQ-25) and the Short Form Health Survey, version 2 (SF-36v2). Flesch-Kincaid and Flesch Reading Ease formulas were used to estimate readability. Individual survey item scores and descriptive statistics for each survey were calculated. Variation of individual item scores from the mean survey score was graphically depicted for each survey. The mean reading grade level and reading ease estimates for the VFQ-25 and SF-36v2 were 7.8 (fairly easy) and 6.4 (easy), respectively. Both surveys had notable variation in item readability; individual item readability scores ranged from 3.7 to 12.0 (very easy to difficult) for the VFQ-25 and 2.2 to 12.0 (very easy to difficult) for the SF-36v2. Because survey respondents may not comprehend items with readability scores that exceed their reading ability, estimating the readability of each survey item is an important component of evaluating survey readability. Standards for measuring the readability of surveys are needed.

Citing Articles

Designing and Validating a Hereditary Spastic Paraplegia-Specific Quality of Life Rating Scale (HSPQoL).

Siow S, Fleming J, Barlow-Stewart K, Wali G, Kumar K, Sue C Cerebellum. 2024; 24(1):14.

PMID: 39681739 PMC: 11649815. DOI: 10.1007/s12311-024-01771-1.

Screening and Assessment for Psychological Distress among Burn Survivors.

Loehr V, Goette W, Roaten K Eur Burn J. 2024; 3(1):57-88.

PMID: 39604177 PMC: 11575395. DOI: 10.3390/ebj3010008.

Readability Metrics in Patient Education: Where Do We Innovate?.

Singh S, Jamal A, Qureshi F Clin Pract. 2024; 14(6):2341-2349.

PMID: 39585011 PMC: 11586978. DOI: 10.3390/clinpract14060183.

Words Can Hurt: A Taxonomy of Verbally Pressured Sexual Exploitation in the SES-V.

Anderson R, Peterson Z, Canan S, Abbey A, McCauley H, Orchowski L J Sex Res. 2024; 61(6):882-896.

PMID: 38973062 PMC: 11232926. DOI: 10.1080/00224499.2024.2358414.

Measures of Patient and Surrogate Preparedness for End-of-Life Decision-Making.

Song M, Higgins M, Ward S, Lee H, Noorani N, Happ M J Pain Symptom Manage. 2024; 67(5):429-440.e2.

PMID: 38355069 PMC: 11032227. DOI: 10.1016/j.jpainsymman.2024.02.005.

References

Mangione C, Lee P, Gutierrez P, Spritzer K, Berry S, Hays R . Development of the 25-item National Eye Institute Visual Function Questionnaire. Arch Ophthalmol. 2001; 119(7):1050-8. DOI: 10.1001/archopht.119.7.1050. View

Ott B, Hardie T . Readability of advance directive documents. Image J Nurs Sch. 1997; 29(1):53-7. DOI: 10.1111/j.1547-5069.1997.tb01140.x. View

Doak L, Doak C, Meade C . Strategies to improve cancer education materials. Oncol Nurs Forum. 1996; 23(8):1305-12. View

Meade C, Byrd J . Patient literacy and the readability of smoking education literature. Am J Public Health. 1989; 79(2):204-6. PMC: 1349937. DOI: 10.2105/ajph.79.2.204. View

Macey B, Bouman C . An evaluation of validity, reliability, and readability of the Critical Care Family Needs Inventory. Heart Lung. 1991; 20(4):398-403. View

Weiss B, Coyne C . Communicating with patients who cannot read. N Engl J Med. 1997; 337(4):272-4. DOI: 10.1056/NEJM199707243370411. View

Powers R . Emergency department patient literacy and the readability of patient-directed materials. Ann Emerg Med. 1988; 17(2):124-6. DOI: 10.1016/s0196-0644(88)80295-6. View

Pande K, de Takats D, Kanis J, Edwards V, Slade P, McCloskey E . Development of a questionnaire (OPQ) to assess patient's knowledge about osteoporosis. Maturitas. 2001; 37(2):75-81. DOI: 10.1016/s0378-5122(00)00165-1. View

Berland G, Elliott M, Morales L, Algazy J, Kravitz R, Broder M . Health information on the Internet: accessibility, quality, and readability in English and Spanish. JAMA. 2001; 285(20):2612-21. PMC: 4182102. DOI: 10.1001/jama.285.20.2612. View

10.

Heyland D, Tranmer J . Measuring family satisfaction with care in the intensive care unit: the development of a questionnaire and preliminary results. J Crit Care. 2002; 16(4):142-9. DOI: 10.1053/jcrc.2001.30163. View

11.

Rowan K . The development and validation of a multi-dimensional measure of chronic foot pain: the ROwan Foot Pain Assessment Questionnaire (ROFPAQ). Foot Ankle Int. 2001; 22(10):795-809. DOI: 10.1177/107110070102201005. View

12.

Berndt D, Schwartz S, Kaiser C . Readability of self-report depression inventories. J Consult Clin Psychol. 1983; 51(4):627-8. DOI: 10.1037//0022-006x.51.4.627. View

13.

Plimpton S, Root J . Materials and strategies that work in low literacy health communication. Public Health Rep. 1994; 109(1):86-92. PMC: 1402246. View

14.

Devins G, Binik Y, Mandin H, Letourneau P, Hollomby D, Barre P . The Kidney Disease Questionnaire: a test for measuring patient knowledge about end-stage renal disease. J Clin Epidemiol. 1990; 43(3):297-307. DOI: 10.1016/0895-4356(90)90010-m. View

15.

Boyd M . A guide to writing effective patient education materials. Nurs Manage. 1987; 18(7):56-7. View

16.

Edlund C . An effective methodology for surveying a Medicaid population: the 1996 Oregon Health Plan client satisfaction survey. J Ambul Care Manage. 1996; 20(1):37-45. DOI: 10.1097/00004479-199701000-00006. View

17.

. Health literacy: report of the Council on Scientific Affairs. Ad Hoc Committee on Health Literacy for the Council on Scientific Affairs, American Medical Association. JAMA. 1999; 281(6):552-7. View

18.

Graber M, Roller C, Kaeble B . Readability levels of patient education material on the World Wide Web. J Fam Pract. 1999; 48(1):58-61. View

19.

Eaden J, Abrams K, Mayberry J . The Crohn's and Colitis Knowledge Score: a test for measuring patient knowledge in inflammatory bowel disease. Am J Gastroenterol. 1999; 94(12):3560-6. DOI: 10.1111/j.1572-0241.1999.01536.x. View

20.

Dolovich L, Nair K, Ciliska D, Lee H, Birch S, Gafni A . The Diabetes Continuity of Care Scale: the development and initial evaluation of a questionnaire that measures continuity of care from the patient perspective. Health Soc Care Community. 2005; 12(6):475-87. DOI: 10.1111/j.1365-2524.2004.00517.x. View