Reliability of the OMERACT Giant Cell Arteritis Ultrasonography Score (OGUS): Results of a Patient-based Exercise Involving Experts and Non-experts in Vascular Ultrasonography

Objective: To test the reliability of the Outcome Measures in Rheumatology Giant cell arteritis (GCA) Ultrasonography Score (OGUS) and other composite scores in a patient-based exercise involving experts and non-experts in vascular ultrasonography.

Methods: Six GCA patients were scanned twice (two rounds separated ≥3 hours) by 12 experts and 12 non-experts. Non-experts received 90 min of theoretical and 240 min of practical training between rounds 1 and 2. Ultrasonography was conducted on temporal arteries (common superficial, frontal and parietal branches) and axillary arteries bilaterally to calculate the OGUS, the Southend score and the Halo count. Inter-reader and intra-reader reliability were assessed by intraclass correlation coefficient (ICC).

Results: Mean age of GCA patients was 78±5.1 years, 2 (33.3%) were women, and all were in clinical remission. Expert inter-reader ICC of the OGUS was 0.60 in both rounds, 0.40 in round 1 and 0.51 in round 2 for the Southend score and 0.45 and 0.52, respectively, for the Halo count. Median ICCs for intra-reader reliability were 0.86, 0.73 and 0.65 for the OGUS, Southend score and Halo count, respectively.For non-experts, inter-reader ICCs in round 1 were 0.20 for the OGUS, 0.20 for a normalised Southend score (=score divided by available segments) and 0.35 for a normalised Halo count. After training, inter-reader reliability ICCs improved to 0.52, 0.29 and 0.54, respectively.

Conclusion: Inter-reader reliability was fair to moderate, and intra-reader reliability was good for OGUS, Southend score and Halo count among experts. Inter-reader reliability of non-experts in vascular ultrasonography improved after the training.

References

Czihal M, Kohler A, Lottspeich C, Prearo I, Hoffmann U, Schulze-Koops H . Temporal artery compression sonography for the diagnosis of giant cell arteritis in elderly patients with acute ocular arterial occlusions. Rheumatology (Oxford). 2020; 60(5):2190-2196. DOI: 10.1093/rheumatology/keaa515. View

Nielsen B, Therkildsen P, Keller K, Gormsen L, Hansen I, Hauge E . Ultrasonography in the assessment of disease activity in cranial and large-vessel giant cell arteritis: a prospective follow-up study. Rheumatology (Oxford). 2023; 62(9):3084-3094. DOI: 10.1093/rheumatology/kead028. View

Sanchez-Alvarez C, Bond M, Soowamber M, Camellino D, Anderson M, Langford C . Measuring treatment outcomes and change in disease activity in giant cell arteritis: a systematic literature review informing the development of the EULAR-ACR response criteria on behalf of the EULAR-ACR response criteria in giant cell arteritis.... RMD Open. 2023; 9(2). PMC: 10314653. DOI: 10.1136/rmdopen-2023-003233. View

Dejaco C, Ramiro S, Bond M, Bosch P, Ponte C, Mackie S . EULAR recommendations for the use of imaging in large vessel vasculitis in clinical practice: 2023 update. Ann Rheum Dis. 2023; 83(6):741-751. DOI: 10.1136/ard-2023-224543. View

De Miguel E, Castillo C, Rodriguez A, de Agustin J . Learning and reliability of colour Doppler ultrasound in giant cell arteritis. Clin Exp Rheumatol. 2009; 27(1 Suppl 52):S53-8. View

Ponte C, Monti S, Scire C, Delvino P, Khmelinskii N, Milanesi A . Ultrasound halo sign as a potential monitoring tool for patients with giant cell arteritis: a prospective analysis. Ann Rheum Dis. 2021; 80(11):1475-1482. DOI: 10.1136/annrheumdis-2021-220306. View

Schafer V, Chrysidis S, Schmidt W, Duftner C, Iagnocco A, Bruyn G . OMERACT definition and reliability assessment of chronic ultrasound lesions of the axillary artery in giant cell arteritis. Semin Arthritis Rheum. 2021; 51(4):951-956. DOI: 10.1016/j.semarthrit.2021.04.014. View

Kobak K, Engelhardt N, Williams J, Lipsitz J . Rater training in multicenter clinical trials: issues and recommendations. J Clin Psychopharmacol. 2004; 24(2):113-7. DOI: 10.1097/01.jcp.0000116651.91923.54. View

Dejaco C, Brouwer E, Mason J, Buttgereit F, Matteson E, Dasgupta B . Giant cell arteritis and polymyalgia rheumatica: current challenges and opportunities. Nat Rev Rheumatol. 2017; 13(10):578-592. DOI: 10.1038/nrrheum.2017.142. View

10.

Schafer V, Juche A, Ramiro S, Krause A, Schmidt W . Ultrasound cut-off values for intima-media thickness of temporal, facial and axillary arteries in giant cell arteritis. Rheumatology (Oxford). 2017; 56(9):1479-1483. DOI: 10.1093/rheumatology/kex143. View

11.

Chrysidis S, Duftner C, Dejaco C, Schafer V, Ramiro S, Carrara G . Definitions and reliability assessment of elementary ultrasound lesions in giant cell arteritis: a study from the OMERACT Large Vessel Vasculitis Ultrasound Working Group. RMD Open. 2018; 4(1):e000598. PMC: 5976098. DOI: 10.1136/rmdopen-2017-000598. View

12.

Bosch P, Dejaco C, Schmidt W, Schluter K, Pregartner G, Schafer V . Ultrasound for diagnosis and follow-up of chronic axillary vasculitis in patients with long-standing giant cell arteritis. Ther Adv Musculoskelet Dis. 2021; 13:1759720X21998505. PMC: 7983430. DOI: 10.1177/1759720X21998505. View

13.

Dejaco C, Ramiro S, Touma Z, Bond M, Soowamber M, Sanchez-Alvarez C . What is a response in randomised controlled trials in giant cell arteritis?. Ann Rheum Dis. 2023; 82(7):897-900. DOI: 10.1136/ard-2022-223751. View

14.

Pfeil A, Krusche M, Vossen D, Berliner M, Keysser G, Krause A . Model curriculum of the German society for Rheumatology for advanced training in the discipline internal medicine and rheumatology. English version. Z Rheumatol. 2021; 80(Suppl 2):64-67. PMC: 8752525. DOI: 10.1007/s00393-021-01080-6. View

15.

Jese R, Rotar Z, Tomsic M, Hocevar A . The cut-off values for the intima-media complex thickness assessed by colour Doppler sonography in seven cranial and aortic arch arteries. Rheumatology (Oxford). 2020; 60(3):1346-1352. DOI: 10.1093/rheumatology/keaa578. View

16.

Koo T, Li M . A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J Chiropr Med. 2016; 15(2):155-63. PMC: 4913118. DOI: 10.1016/j.jcm.2016.02.012. View

17.

Dejaco C, Ponte C, Monti S, Rozza D, Scire C, Terslev L . The provisional OMERACT ultrasonography score for giant cell arteritis. Ann Rheum Dis. 2023; 82(4):556-564. DOI: 10.1136/ard-2022-223367. View

18.

van der Geest K, Wolfe K, Borg F, Sebastian A, Kayani A, Tomelleri A . Ultrasonographic Halo Score in giant cell arteritis: association with intimal hyperplasia and ischaemic sight loss. Rheumatology (Oxford). 2020; 60(9):4361-4366. PMC: 8410002. DOI: 10.1093/rheumatology/keaa806. View

19.

Dejaco C, Kerschbaumer A, Aletaha D, Bond M, Hysa E, Camellino D . Treat-to-target recommendations in giant cell arteritis and polymyalgia rheumatica. Ann Rheum Dis. 2023; 83(1):48-57. PMC: 10803996. DOI: 10.1136/ard-2022-223429. View

20.

Seitz L, Christ L, Lotscher F, Scholz G, Sarbu A, Butikofer L . Quantitative ultrasound to monitor the vascular response to tocilizumab in giant cell arteritis. Rheumatology (Oxford). 2021; 60(11):5052-5059. PMC: 8566271. DOI: 10.1093/rheumatology/keab484. View