Development of the American College of Rheumatology's Rheumatoid Arthritis Electronic Clinical Quality Measures

Objective: Electronic clinical quality measures (eCQMs) rely on computer algorithms to extract data from electronic health records (EHRs). On behalf of the American College of Rheumatology (ACR), we sought to develop and test eCQMs for rheumatoid arthritis (RA).

Methods: Drawing from published ACR guidelines, a working group developed candidate RA process measures and subsequently assessed face validity through an interdisciplinary panel of health care stakeholders. A public comment period followed. Measures that passed these levels of review were electronically specified using the quality data model, which provides standard nomenclature for data elements (category, datatype, and value sets) obtained through an EHR. For each eCQM, 3 clinical sites using different EHR systems tested the scientific feasibility and validity of measures. Measures appropriate for accountability were presented for national endorsement.

Results: Expert panel validity ratings were high for all measures (median 8-9 of 9). Health system performance on the eCQMs was 53.6% for RA disease activity assessment, 69.1% for functional status assessment, 93.1% for disease-modifying antirheumatic drug (DMARD) use, and 72.8% for tuberculosis screening. Kappa statistics, which evaluated whether the eCQM validly captured data obtained from manual EHR chart review, demonstrated moderate to substantial agreement (0.54 for functional status assessment, 0.73 for tuberculosis screening, 0.84 for disease activity, and 0.85 for DMARD use).

Conclusion: Four eCQMs for RA have achieved national endorsement and are recommended for use in federal quality reporting programs. Implementation and further refinement of these measures is ongoing in the ACR's registry, the Rheumatology Informatics System for Effectiveness (RISE).