Measuring Patients' Experiences with Individual Primary Care Physicians. Results of a Statewide Demonstration Project

Overview

Journal J Gen Intern Med

Publisher Springer

Specialty General Medicine

Date 2006 Jan 21

PMID 16423118

Citations 100

Authors

Dana Gelb Safran

Melinda Karp

Kathryn Coltin

Hong Chang

Angela Li

John Ogren

William H Rogers

Affiliations

Soon will be listed here.

Abstract

Background: Measuring and reporting patients' experiences with health plans has been routine for several years. There is now substantial interest in measuring patients' experiences with individual physicians, but numerous concerns remain.

Objective: The Massachusetts Ambulatory Care Experiences Survey Project was a statewide demonstration project designed to test the feasibility and value of measuring patients' experiences with individual primary care physicians and their practices.

Design: Cross-sectional survey administered to a statewide sample by mail and telephone (May-August 2002).

Patients: Adult patients from 5 commerical health plans and Medicaid sampled from the panels of 215 generalist physicians at 67 practice sites (n=9,625).

Measurements: Ambulatory Care Experiences Survey produces 11 summary measures of patients' experiences across 2 domains: quality of physician-patient interactions and organizational features of care. Physician-level reliability was computed for all measures, and variance components analysis was used to determine the influence of each level of the system (physician, site, network organization, plan) on each measure. Risk of misclassifying individual physicians was evaluated under varying reporting frameworks.

Results: All measures except 2 achieved physician-level reliability of at least 0.70 with samples of 45 patients per physician, and several exceeded 0.80. Physicians and sites accounted for the majority of system-related variance on all measures, with physicians accounting for the majority on all "interaction quality" measures (range: 61.7% to 83.9%) and sites accounting for the largest share on "organizational" measures (range: 44.8% to 81.1%). Health plans accounted for neglible variance (<3%) on all measures. Reporting frameworks and principles for assuring misclassification risk < or =2.5% were identified.

Conclusions: With considerable national attention on the importance of patient-centered care, this project demonstrates the feasibility of obtaining highly reliable measures of patients' experiences with individual physicians and practices. The analytic findings underscore the validity and importance of looking beyond health plans to individual physicians and sites as we seek to improve health care quality.

Citing Articles

Variation in benefit among patients with serious mental illness who receive integrated psychiatric and primary care.

Young A, Skela J, Chang E, Oberman R, Siddarth P PLoS One. 2024; 19(5):e0304312.

PMID: 38781176 PMC: 11115296. DOI: 10.1371/journal.pone.0304312.

The Characteristics of People with Serious Mental Illness Who are at High Risk for Hospitalization or Death.

Young A, Skela J, Siddarth P Community Ment Health J. 2024; 60(7):1243-1246.

PMID: 38653869 DOI: 10.1007/s10597-024-01281-8.

Bibliometric and visualization analysis of risk management in the doctor-patient relationship: A systematic quantitative literature review.

Li H, Zhang C, Li L, Liu T, Zhang L, Hao J Medicine (Baltimore). 2024; 103(16):e37807.

PMID: 38640335 PMC: 11029958. DOI: 10.1097/MD.0000000000037807.

Patients' Experience of Specialty Care Coordination: Survey Development and Validation.

Vimalananda V, Meterko M, Sitter K, Qian S, Wormwood J, Fincke B J Patient Cent Res Rev. 2023; 10(4):219-230.

PMID: 38046998 PMC: 10688916. DOI: 10.17294/2330-0698.2027.

Are primary care consultations in Trinidad patient-centered? A cross-sectional study of patients with non-communicable diseases.

Rahaman R, Motilal M, Khan R, Maharaj R BMC Prim Care. 2023; 24(1):215.

PMID: 37865738 PMC: 10589933. DOI: 10.1186/s12875-023-02149-8.

References

Keeter S, Miller C, Kohut A, Groves R, Presser S . Consequences of reducing nonresponse in a national telephone survey. Public Opin Q. 2000; 64(2):125-48. DOI: 10.1086/317759. View

Orav E, Wright E, Palmer R, Hargraves J . Issues of variability and bias affecting multisite measurement of quality of care. Med Care. 1996; 34(9 Suppl):SS87-101. DOI: 10.1097/00005650-199609002-00009. View

Francis V, Korsch B, Morris M . Gaps in doctor-patient communication. Patients' response to medical advice. N Engl J Med. 1969; 280(10):535-40. DOI: 10.1056/NEJM196903062801004. View

Hays R, Shaul J, Williams V, Lubalin J, Sweeny S, Cleary P . Psychometric properties of the CAHPS 1.0 survey measures. Consumer Assessment of Health Plans Study. Med Care. 1999; 37(3 Suppl):MS22-31. DOI: 10.1097/00005650-199903001-00003. View

Lee T, Meyer G, Brennan T . A middle ground on public accountability. N Engl J Med. 2004; 350(23):2409-12. DOI: 10.1056/NEJMsb041193. View

Safran D . Defining the future of primary care: what can we learn from patients?. Ann Intern Med. 2003; 138(3):248-55. DOI: 10.7326/0003-4819-138-3-200302040-00033. View

Hofer T, Hayward R, Greenfield S, Wagner E, Kaplan S, Manning W . The unreliability of individual physician "report cards" for assessing the costs and quality of care of a chronic disease. JAMA. 1999; 281(22):2098-105. DOI: 10.1001/jama.281.22.2098. View

Fowler Jr F, Gallagher P, Stringfellow V, Zaslavsky A, Thompson J, Cleary P . Using telephone interviews to reduce nonresponse bias to mail surveys of health plan members. Med Care. 2002; 40(3):190-200. DOI: 10.1097/00005650-200203000-00003. View

Hayward R, Manning Jr W, McMahon Jr L, Bernard A . Do attending or resident physician practice styles account for variations in hospital resource use?. Med Care. 1994; 32(8):788-94. DOI: 10.1097/00005650-199408000-00003. View

10.

Allen Jr H, Rogers W . The consumer health plan value survey: round two. Health Aff (Millwood). 1997; 16(4):156-66. DOI: 10.1377/hlthaff.16.4.156. View

11.

Safran D, Taira D, Rogers W, Kosinski M, Ware J, TARLOV A . Linking primary care performance to outcomes of care. J Fam Pract. 1998; 47(3):213-20. View

12.

Levinson W, Roter D, Mullooly J, Dull V, Frankel R . Physician-patient communication. The relationship with malpractice claims among primary care physicians and surgeons. JAMA. 1997; 277(7):553-9. DOI: 10.1001/jama.277.7.553. View

13.

Landon B, Wilson I, Cleary P . A conceptual model of the effects of health care organizations on the quality of medical care. JAMA. 1998; 279(17):1377-82. DOI: 10.1001/jama.279.17.1377. View

14.

Safran D, Montgomery J, Chang H, Murphy J, Rogers W . Switching doctors: predictors of voluntary disenrollment from a primary physician's practice. J Fam Pract. 2001; 50(2):130-6. View

15.

Murphy J, Chang H, Montgomery J, Rogers W, Safran D . The quality of physician-patient relationships. Patients' experiences 1996-1999. J Fam Pract. 2001; 50(2):123-9. View

16.

Solomon L, Zaslavsky A, Landon B, Cleary P . Variation in patient-reported quality among health care organizations. Health Care Financ Rev. 2002; 23(4):85-100. PMC: 4194762. View

17.

Hebert R, Bravo G, Korner-Bitensky N, Voyer L . Refusal and information bias associated with postal questionnaires and face-to-face interviews in very elderly subjects. J Clin Epidemiol. 1996; 49(3):373-81. DOI: 10.1016/0895-4356(95)00527-7. View

18.

Jencks S, Huff E, Cuerdon T . Change in the quality of care delivered to Medicare beneficiaries, 1998-1999 to 2000-2001. JAMA. 2003; 289(3):305-12. DOI: 10.1001/jama.289.3.305. View

19.

Hickson G, Clayton E, Entman S, Miller C, Githens P, Sloan F . Obstetricians' prior malpractice experience and patients' satisfaction with care. JAMA. 1994; 272(20):1583-7. View

20.

Roter D, Hall J, Kern D, Barker L, Cole K, Roca R . Improving physicians' interviewing skills and reducing patients' emotional distress. A randomized clinical trial. Arch Intern Med. 1995; 155(17):1877-84. View