Interobserver Agreement Among Uveitis Experts on Uveitic Diagnoses: The Standardization of Uveitis Nomenclature Experience

Overview

Journal Am J Ophthalmol

Specialty Ophthalmology

Date 2017 Nov 11

PMID 29122577

Citations 35

Authors

Douglas A Jabs

Andrew Dick

John T Doucette

Amod Gupta

Susan Lightman

Peter McCluskey

Annabelle A Okada

Alan G Palestine

James T Rosenbaum

Sophia M Saleem

Jennifer Thorne

Brett Trusko

Affiliations

Soon will be listed here.

Abstract

Purpose: To evaluate the interobserver agreement among uveitis experts on the diagnosis of the specific uveitic disease.

Design: Interobserver agreement analysis.

Methods: Five committees, each comprised of 9 individuals and working in parallel, reviewed cases from a preliminary database of 25 uveitic diseases, collected by disease, and voted independently online whether the case was the disease in question or not. The agreement statistic, κ, was calculated for the 36 pairwise comparisons for each disease, and a mean κ was calculated for each disease. After the independent online voting, committee consensus conference calls, using nominal group techniques, reviewed all cases not achieving supermajority agreement (>75%) on the diagnosis in the online voting to attempt to arrive at a supermajority agreement.

Results: A total of 5766 cases for the 25 diseases were evaluated. The overall mean κ for the entire project was 0.39, with disease-specific variation ranging from 0.23 to 0.79. After the formalized consensus conference calls to address cases that did not achieve supermajority agreement in the online voting, supermajority agreement overall was reached on approximately 99% of cases, with disease-specific variation ranging from 96% to 100%.

Conclusions: Agreement among uveitis experts on diagnosis is moderate at best but can be improved by discussion among them. These data suggest the need for validated and widely used classification criteria in the field of uveitis.

Citing Articles

Automated quantification of anterior chamber cells using swept-source anterior segment optical coherence tomography.

Pillar S, Kadomoto S, Chen K, Gonzalez S, Cherian N, Privratsky J J Ophthalmic Inflamm Infect. 2025; 15(1):3.

PMID: 39786628 PMC: 11717729. DOI: 10.1186/s12348-025-00456-y.

Artificial Intelligence in Uveitis: Innovations in Diagnosis and Therapeutic Strategies.

Murugan S, Sanjay S, Somanath A, Mahendradas P, Patil A, Kaur K Clin Ophthalmol. 2024; 18:3753-3766.

PMID: 39703602 PMC: 11656483. DOI: 10.2147/OPTH.S495307.

The impact of aqueous humor polymerase chain reaction and serological test results for establishing infectious uveitis diagnosis: An Indonesian experience.

Putera I, La Distia Nora R, Utami N, Karuniawati A, Yasmon A, Wulandari D Heliyon. 2022; 8(10):e10988.

PMID: 36262302 PMC: 9573923. DOI: 10.1016/j.heliyon.2022.e10988.

The standardisation of uveitis nomenclature (SUN) project.

Jabs D, McCluskey P, Palestine A, Thorne J Clin Exp Ophthalmol. 2022; .

PMID: 36164924 PMC: 10040472. DOI: 10.1111/ceo.14175.

Assessment of Anterior Uveitis Through Anterior-Segment Optical Coherence Tomography and Artificial Intelligence-Based Image Analyses.

Sorkhabi M, Potapenko I, Ilginis T, Alberti M, Cabrerizo J Transl Vis Sci Technol. 2022; 11(4):7.

PMID: 35394486 PMC: 8994203. DOI: 10.1167/tvst.11.4.7.

References

Petty R, Southwood T, Manners P, Baum J, Glass D, Goldenberg J . International League of Associations for Rheumatology classification of juvenile idiopathic arthritis: second revision, Edmonton, 2001. J Rheumatol. 2004; 31(2):390-2. View

Jabs D, Nussenblatt R, Rosenbaum J . Standardization of uveitis nomenclature for reporting clinical data. Results of the First International Workshop. Am J Ophthalmol. 2005; 140(3):509-16. PMC: 8935739. DOI: 10.1016/j.ajo.2005.03.057. View

Engstrom Jr R, Holland G, Margolis T, Muccioli C, Lindley J, Belfort Jr R . The progressive outer retinal necrosis syndrome. A variant of necrotizing herpetic retinopathy in patients with AIDS. Ophthalmology. 1994; 101(9):1488-502. DOI: 10.1016/s0161-6420(94)31142-0. View

Kilmartin D, Dick A, Forrester J . Prospective surveillance of sympathetic ophthalmia in the UK and Republic of Ireland. Br J Ophthalmol. 2000; 84(3):259-63. PMC: 1723405. DOI: 10.1136/bjo.84.3.259. View

Mackensen F, Smith J, Rosenbaum J . Enhanced recognition, treatment, and prognosis of tubulointerstitial nephritis and uveitis syndrome. Ophthalmology. 2007; 114(5):995-9. DOI: 10.1016/j.ophtha.2007.01.002. View

Read R, Holland G, RAO N, Tabbara K, Ohno S, Arellanes-Garcia L . Revised diagnostic criteria for Vogt-Koyanagi-Harada disease: report of an international committee on nomenclature. Am J Ophthalmol. 2001; 131(5):647-52. DOI: 10.1016/s0002-9394(01)00925-4. View

Petri M, Orbai A, Alarcon G, Gordon C, Merrill J, Fortin P . Derivation and validation of the Systemic Lupus International Collaborating Clinics classification criteria for systemic lupus erythematosus. Arthritis Rheum. 2012; 64(8):2677-86. PMC: 3409311. DOI: 10.1002/art.34473. View

Rudwaleit M, van der Heijde D, Landewe R, Akkoc N, Brandt J, Chou C . The Assessment of SpondyloArthritis International Society classification criteria for peripheral spondyloarthritis and for spondyloarthritis in general. Ann Rheum Dis. 2010; 70(1):25-31. DOI: 10.1136/ard.2010.133645. View

Levinson R, Brezin A, Rothova A, Accorinti M, Holland G . Research criteria for the diagnosis of birdshot chorioretinopathy: results of an international consensus conference. Am J Ophthalmol. 2006; 141(1):185-7. DOI: 10.1016/j.ajo.2005.08.025. View

10.

Tan E, Cohen A, Fries J, MASI A, McShane D, Rothfield N . The 1982 revised criteria for the classification of systemic lupus erythematosus. Arthritis Rheum. 1982; 25(11):1271-7. DOI: 10.1002/art.1780251101. View

11.

Aggarwal R, Ringold S, Khanna D, Neogi T, Johnson S, Miller A . Distinctions between diagnostic and classification criteria?. Arthritis Care Res (Hoboken). 2015; 67(7):891-7. PMC: 4482786. DOI: 10.1002/acr.22583. View

12.

Petty R, Southwood T, Baum J, Bhettay E, Glass D, Manners P . Revision of the proposed classification criteria for juvenile idiopathic arthritis: Durban, 1997. J Rheumatol. 1998; 25(10):1991-4. View

13.

Van der Lelij A, Ooijman F, Kijlstra A, Rothova A . Anterior uveitis with sectoral iris atrophy in the absence of keratitis: a distinct clinical entity among herpetic eye diseases. Ophthalmology. 2000; 107(6):1164-70. DOI: 10.1016/s0161-6420(00)00115-9. View

14.

Mandeville J, Levinson R, Holland G . The tubulointerstitial nephritis and uveitis syndrome. Surv Ophthalmol. 2001; 46(3):195-208. DOI: 10.1016/s0039-6257(01)00261-2. View

15.

Herbort C, Rao N, Mochizuki M . International criteria for the diagnosis of ocular sarcoidosis: results of the first International Workshop On Ocular Sarcoidosis (IWOS). Ocul Immunol Inflamm. 2009; 17(3):160-9. DOI: 10.1080/09273940902818861. View

16.

Holland G . Standard diagnostic criteria for the acute retinal necrosis syndrome. Executive Committee of the American Uveitis Society. Am J Ophthalmol. 1994; 117(5):663-7. DOI: 10.1016/s0002-9394(14)70075-3. View

17.

Jones N . Fuchs' heterochromic uveitis: an update. Surv Ophthalmol. 1993; 37(4):253-72. DOI: 10.1016/0039-6257(93)90009-v. View

18.

Okada A, Jabs D . The standardization of uveitis nomenclature project: the future is here. JAMA Ophthalmol. 2013; 131(6):787-9. DOI: 10.1001/jamaophthalmol.2013.1596. View

19.

Van Calster B, Van Belle V, Vergouwe Y, Timmerman D, Van Huffel S, Steyerberg E . Extending the c-statistic to nominal polytomous outcomes: the Polytomous Discrimination Index. Stat Med. 2012; 31(23):2610-26. DOI: 10.1002/sim.5321. View

20.

Rudwaleit M, van der Heijde D, Landewe R, Listing J, Akkoc N, Brandt J . The development of Assessment of SpondyloArthritis international Society classification criteria for axial spondyloarthritis (part II): validation and final selection. Ann Rheum Dis. 2009; 68(6):777-83. DOI: 10.1136/ard.2009.108233. View