How Accurate Are Self-reports? Analysis of Self-reported Health Care Utilization and Absence when Compared with Administrative Data

Overview

Journal J Occup Environ Med

Specialty Environmental Health

Date 2009 Jun 17

PMID 19528832

Citations 150

Authors

Meghan E Short

Ron Z Goetzel

Xiaofei Pei

Maryam J Tabrizi

Ronald J Ozminkowski

Teresa B Gibson

Dave M Dejoy

Mark G Wilson

Affiliations

Soon will be listed here.

Abstract

Objective: To determine the accuracy of self-reported health care utilization and absence reported on health risk assessments against administrative claims and human resource records.

Methods: Self-reported values of health care utilization and absenteeism were analyzed for concordance to administrative claims values. Percent agreement, Pearson's correlations, and multivariate logistic regression models examined the level of agreement and characteristics of participants with concordance.

Results: Self-report and administrative data showed greater concordance for monthly compared with yearly health care utilization metrics. Percent agreement ranged from 30% to 99% with annual doctor visits having the lowest percent agreement. Younger people, males, those with higher education, and healthier individuals more accurately reported their health care utilization and absenteeism.

Conclusions: Self-reported health care utilization and absenteeism may be used as a proxy when medical claims and administrative data are unavailable, particularly for shorter recall periods.

Citing Articles

Self-reported and tracker-estimated physical activity outcomes in women with chronic pelvic pain disorders: A longitudinal evaluation of construct validity.

Nagaldinne T, Shahnawaz S, Bakken S, Elhadad N, Horan E, Ewing-Garber C medRxiv. 2025; .

PMID: 39990544 PMC: 11844612. DOI: 10.1101/2025.02.10.25322006.

Breast Cancer MRI Screening of Patients After Multiplex Gene Panel Testing.

Naghi L, Culver J, Ricker C, Sturgeon D, Kingham K, Hodan R JAMA Netw Open. 2025; 8(1):e2454447.

PMID: 39804645 PMC: 11731224. DOI: 10.1001/jamanetworkopen.2024.54447.

Sun protection behaviors, healthcare access, and smoking among melanoma survivors.

Xie J, Kiuru M, Pollock B, Keegan T J Cancer Surviv. 2024; .

PMID: 39652141 DOI: 10.1007/s11764-024-01727-8.

Cost-Effectiveness of Implementation Facilitation to Promote Emergency Department-Initiated Buprenorphine for Opioid Use Disorder.

Lu T, Ryan D, Cadet T, Chawarski M, Coupet E, Edelman E Ann Emerg Med. 2024; 85(3):205-213.

PMID: 39570250 PMC: 11845297. DOI: 10.1016/j.annemergmed.2024.10.001.

Exploring the role of identity in pro-environmental behavior: cultural and educational influences on younger generations.

Wild S, Schulze Heuling L Front Psychol. 2024; 15:1459165.

PMID: 39444836 PMC: 11497401. DOI: 10.3389/fpsyg.2024.1459165.

References

Zapka J, Bigelow C, Hurley T, Ford L, Egelhofer J, Cloud W . Mammography use among sociodemographically diverse women: the accuracy of self-report. Am J Public Health. 1996; 86(7):1016-21. PMC: 1380445. DOI: 10.2105/ajph.86.7.1016. View

Rhodes A, Fung K . Self-reported use of mental health services versus administrative records: care to recall?. Int J Methods Psychiatr Res. 2004; 13(3):165-75. PMC: 6878470. DOI: 10.1002/mpr.172. View

Marshall S, Deapen D, Allen M, Anton-Culver H, Bernstein L, Horn-Ross P . Validating California teachers study self-reports of recent hospitalization: comparison with California hospital discharge data. Am J Epidemiol. 2003; 158(10):1012-20. DOI: 10.1093/aje/kwg256. View

de Groot V, Beckerman H, Lankhorst G, Bouter L . How to measure comorbidity. a critical review of available methods. J Clin Epidemiol. 2003; 56(3):221-9. DOI: 10.1016/s0895-4356(02)00585-1. View

Amick 3rd B, Lerner D, Rogers W, Rooney T, Katz J . A review of health-related work outcome measures and their uses, and recommended measures. Spine (Phila Pa 1976). 2000; 25(24):3152-60. DOI: 10.1097/00007632-200012150-00010. View

Bhandari A, Wagner T . Self-reported utilization of health care services: improving measurement and accuracy. Med Care Res Rev. 2006; 63(2):217-35. DOI: 10.1177/1077558705285298. View

Muhajarine N, Mustard C, Roos L, Young T, Gelskey D . Comparison of survey and physician claims data for detecting hypertension. J Clin Epidemiol. 1997; 50(6):711-8. DOI: 10.1016/s0895-4356(97)00019-x. View

Ritter P, Stewart A, Kaymaz H, Sobel D, Block D, Lorig K . Self-reports of health care utilization compared to provider records. J Clin Epidemiol. 2001; 54(2):136-41. DOI: 10.1016/s0895-4356(00)00261-4. View

Fowles J, Rosheim K, Fowler E, Craft C, Arrichiello L . The validity of self-reported diabetes quality of care measures. Int J Qual Health Care. 1999; 11(5):407-12. DOI: 10.1093/intqhc/11.5.407. View

10.

Quesenberry Jr C, Caan B, Jacobson A . Obesity, health services use, and health care costs among members of a health maintenance organization. Arch Intern Med. 1998; 158(5):466-72. DOI: 10.1001/archinte.158.5.466. View

11.

Raebel M, Malone D, Conner D, Xu S, Porter J, Lanty F . Health services use and health care costs of obese and nonobese individuals. Arch Intern Med. 2004; 164(19):2135-40. DOI: 10.1001/archinte.164.19.2135. View

12.

Petrou S, Murray L, Cooper P, Davidson L . The accuracy of self-reported healthcare resource utilization in health economic studies. Int J Technol Assess Health Care. 2002; 18(3):705-10. DOI: 10.1017/s026646230200051x. View

13.

Evanoff B, Abedin S, Grayson D, Dale A, Wolf L, Bohr P . Is disability underreported following work injury?. J Occup Rehabil. 2002; 12(3):139-50. DOI: 10.1023/a:1016838510682. View

14.

Revicki D, Irwin D, Reblando J, Simon G . The accuracy of self-reported disability days. Med Care. 1994; 32(4):401-4. DOI: 10.1097/00005650-199404000-00008. View

15.

Roberts R, Bergstralh E, Schmidt L, Jacobsen S . Comparison of self-reported and medical record health care utilization measures. J Clin Epidemiol. 1996; 49(9):989-95. DOI: 10.1016/0895-4356(96)00143-6. View

16.

Beckles G, Williamson D, Brown A, Gregg E, Karter A, Kim C . Agreement between self-reports and medical records was only fair in a cross-sectional study of performance of annual eye examinations among adults with diabetes in managed care. Med Care. 2007; 45(9):876-83. DOI: 10.1097/MLR.0b013e3180ca95fa. View

17.

Jobe J, White A, Kelley C, Mingay D, Sanchez M, Loftus E . Recall strategies and memory for health-care visits. Milbank Q. 1990; 68(2):171-89. View

18.

Ozminkowski R, Wang S, Marder W, Azzolini J . Short-run associations between medical care expenditures and adherence to clinical practice guideline-based measures for diabetes. Value Health. 2006; 3 Suppl 1:29-38. DOI: 10.1046/j.1524-4733.2000.36013.x. View

19.

Charlson M, Pompei P, Ales K, MacKenzie C . A new method of classifying prognostic comorbidity in longitudinal studies: development and validation. J Chronic Dis. 1987; 40(5):373-83. DOI: 10.1016/0021-9681(87)90171-8. View

20.

Reijneveld S . The cross-cultural validity of self-reported use of health care: a comparison of survey and registration data. J Clin Epidemiol. 2000; 53(3):267-72. DOI: 10.1016/s0895-4356(99)00138-9. View