An International Comparison of Retinopathy of Prematurity Grading Performance Within the Benefits of Oxygen Saturation Targeting II Trials

Overview

Journal Eye (Lond)

Specialty Ophthalmology

Date 2017 Jul 29

PMID 28752837

Citations 27

Authors

B W Fleck

C Williams

E Juszczak

K Cocker

B J Stenson

B A Darlow

S Dai

G A Gole

G E Quinn

D K Wallace

A Ells

S Carden

L Butler

D Clark

J Elder

C Wilson

S Biswas

A Shafiq

A King

P Brocklehurst

A R Fielder

Affiliations

Soon will be listed here.

Abstract

PurposeTo investigate whether the observed international differences in retinopathy of prematurity (ROP) treatment rates within the Benefits of Oxygen Saturation Targeting (BOOST) II trials might have been caused by international variation in ROP disease grading.MethodsGroups of BOOST II trial ophthalmologists in UK, Australia, and New Zealand (ANZ), and an international reference group (INT) used a web based system to grade a selection of RetCam images of ROP acquired during the BOOST II UK trial. Rates of decisions to treat, plus disease grading, ROP stage grading, ROP zone grading, inter-observer variation within groups and intra-observer variation within groups were measured.ResultsForty-two eye examinations were graded. UK ophthalmologists diagnosed treat-requiring ROP more frequently than ANZ ophthalmologists, 13.9 (3.49) compared to 9.4 (4.46) eye examinations, P=0.038. UK ophthalmologists diagnosed plus disease more frequently than ANZ ophthalmologists, 14.1 (6.23) compared to 8.5 (3.24) eye examinations, P=0.021. ANZ ophthalmologists diagnosed stage 2 ROP more frequently than UK ophthalmologists, 20.2 (5.8) compared to 12.7 (7.1) eye examinations, P=0.026. There were no other significant differences in the grading of ROP stage or zone. Inter-observer variation was higher within the UK group than within the ANZ group. Intra-observer variation was low in both groups.ConclusionsWe have found evidence of international variation in the diagnosis of treatment-requiring ROP. Improved standardisation of the diagnosis of treatment-requiring ROP is required. Measures might include improved training in the grading of ROP, using an international approach, and further development of ROP image analysis software.

Citing Articles

Reduction of pathological retinal neovascularization, vessel obliteration, and artery tortuosity by PEDF protein in an oxygen-induced ischemic retinopathy rat model.

Zhao S, Tschulakow A, Karthikeyan S, Wang K, Kochanek S, Schraermeyer U FASEB Bioadv. 2024; 6(9):311-326.

PMID: 39399476 PMC: 11467744. DOI: 10.1096/fba.2024-00059.

P Score: A Reference Image-Based Clinical Grading Scale for Vascular Change in Retinopathy of Prematurity.

Binenbaum G, Stahl A, Coyner A, He J, Ying G, Ostmo S Ophthalmology. 2024; 131(11):1297-1303.

PMID: 38795976 PMC: 11499040. DOI: 10.1016/j.ophtha.2024.05.019.

Implementation of optical coherence tomography in retinopathy of prematurity screening.

Hanif A, Jian Y, Young B, Campbell J Curr Opin Ophthalmol. 2024; 35(3):252-259.

PMID: 38205941 PMC: 11034813. DOI: 10.1097/ICU.0000000000001030.

Development and validation of an artificial intelligence based screening tool for detection of retinopathy of prematurity in a South Indian population.

Parthasarathy Rao D, Savoy F, Tan J, Fung B, Bopitiya C, Sivaraman A Front Pediatr. 2023; 11:1197237.

PMID: 37794964 PMC: 10545957. DOI: 10.3389/fped.2023.1197237.

Multicenter Validation of Deep Learning Algorithm ROP.AI for the Automated Diagnosis of Plus Disease in ROP.

Bai A, Dai S, Hung J, Kirpalani A, Russell H, Elder J Transl Vis Sci Technol. 2023; 12(8):13.

PMID: 37578427 PMC: 10431208. DOI: 10.1167/tvst.12.8.13.

References

Wilson C, Cocker K, Moseley M, Paterson C, Clay S, Schulenburg W . Computerized analysis of retinal vessel width and tortuosity in premature infants. Invest Ophthalmol Vis Sci. 2008; 49(8):3577-85. DOI: 10.1167/iovs.07-1353. View

Chiang M, Keenan J, Starren J, Du Y, Schiff W, Barile G . Accuracy and reliability of remote retinopathy of prematurity diagnosis. Arch Ophthalmol. 2006; 124(3):322-7. DOI: 10.1001/archopht.124.3.322. View

Dhaliwal C, Fleck B, Wright E, Graham C, McIntosh N . Incidence of retinopathy of prematurity in Lothian, Scotland, from 1990 to 2004. Arch Dis Child Fetal Neonatal Ed. 2008; 93(6):F422-6. DOI: 10.1136/adc.2007.134791. View

Williams S, Wang L, Kane S, Lee T, Weissgold D, Berrocal A . Telemedical diagnosis of retinopathy of prematurity: accuracy of expert versus non-expert graders. Br J Ophthalmol. 2009; 94(3):351-6. PMC: 3711625. DOI: 10.1136/bjo.2009.166348. View

Darlow B, Elder M, Horwood L, Donoghue D, Henderson-Smart D . Does observer bias contribute to variations in the rate of retinopathy of prematurity between centres?. Clin Exp Ophthalmol. 2008; 36(1):43-6. DOI: 10.1111/j.1442-9071.2007.01652.x. View

Paul Chan R, Williams S, Yonekawa Y, Weissgold D, Lee T, Chiang M . Accuracy of retinopathy of prematurity diagnosis by retinal fellows. Retina. 2010; 30(6):958-65. PMC: 2884082. DOI: 10.1097/IAE.0b013e3181c9696a. View

. The International Classification of Retinopathy of Prematurity revisited. Arch Ophthalmol. 2005; 123(7):991-9. DOI: 10.1001/archopht.123.7.991. View

Tan Z, Chong C, Darlow B, Dai S . Visual impairment due to retinopathy of prematurity (ROP) in New Zealand: a 22-year review. Br J Ophthalmol. 2014; 99(6):801-6. DOI: 10.1136/bjophthalmol-2014-305913. View

Campbell J, Ataer-Cansizoglu E, Bolon-Canedo V, Bozkurt A, Erdogmus D, Kalpathy-Cramer J . Expert Diagnosis of Plus Disease in Retinopathy of Prematurity From Computer-Based Image Analysis. JAMA Ophthalmol. 2016; 134(6):651-7. PMC: 5201139. DOI: 10.1001/jamaophthalmol.2016.0611. View

10.

Walton 4th O, Garoon R, Weng C, Gross J, Young A, Camero K . Evaluation of Automated Teleretinal Screening Program for Diabetic Retinopathy. JAMA Ophthalmol. 2016; 134(2):204-9. DOI: 10.1001/jamaophthalmol.2015.5083. View

11.

Askie L, Brocklehurst P, Darlow B, Finer N, Schmidt B, Tarnow-Mordi W . NeOProM: Neonatal Oxygenation Prospective Meta-analysis Collaboration study protocol. BMC Pediatr. 2011; 11:6. PMC: 3025869. DOI: 10.1186/1471-2431-11-6. View

12.

Stoll B, Hansen N, Bell E, Walsh M, Carlo W, Shankaran S . Trends in Care Practices, Morbidity, and Mortality of Extremely Preterm Neonates, 1993-2012. JAMA. 2015; 314(10):1039-51. PMC: 4787615. DOI: 10.1001/jama.2015.10244. View

13.

Gschliesser A, Stifter E, Neumayer T, Moser E, Papp A, Pircher N . Inter-expert and intra-expert agreement on the diagnosis and treatment of retinopathy of prematurity. Am J Ophthalmol. 2015; 160(3):553-560.e3. DOI: 10.1016/j.ajo.2015.05.016. View

14.

Reynolds J, Dobson V, Quinn G, Fielder A, Palmer E, Saunders R . Evidence-based screening criteria for retinopathy of prematurity: natural history data from the CRYO-ROP and LIGHT-ROP studies. Arch Ophthalmol. 2002; 120(11):1470-6. DOI: 10.1001/archopht.120.11.1470. View

15.

Carlo W, Finer N, Walsh M, Rich W, Gantz M, Laptook A . Target ranges of oxygen saturation in extremely preterm infants. N Engl J Med. 2010; 362(21):1959-69. PMC: 2891970. DOI: 10.1056/NEJMoa0911781. View

16.

Blencowe H, Lawn J, Vazquez T, Fielder A, Gilbert C . Preterm-associated visual impairment and estimates of retinopathy of prematurity at regional and global levels for 2010. Pediatr Res. 2013; 74 Suppl 1:35-49. PMC: 3873709. DOI: 10.1038/pr.2013.205. View

17.

Myung J, Chan R, Espiritu M, Williams S, Granet D, Lee T . Accuracy of retinopathy of prematurity image-based diagnosis by pediatric ophthalmology fellows: implications for training. J AAPOS. 2011; 15(6):573-8. PMC: 3240850. DOI: 10.1016/j.jaapos.2011.06.011. View

18.

Abbey A, Besirli C, Musch D, Andrews C, Capone Jr A, Drenser K . Evaluation of Screening for Retinopathy of Prematurity by ROPtool or a Lay Reader. Ophthalmology. 2015; 123(2):385-390. DOI: 10.1016/j.ophtha.2015.09.048. View

19.

Chiang M, Starren J, Du Y, Keenan J, Schiff W, Barile G . Remote image based retinopathy of prematurity diagnosis: a receiver operating characteristic analysis of accuracy. Br J Ophthalmol. 2006; 90(10):1292-6. PMC: 1857452. DOI: 10.1136/bjo.2006.091900. View

20.

Darlow B, Marschner S, Donoghoe M, Battin M, Broadbent R, Elder M . Randomized controlled trial of oxygen saturation targets in very preterm infants: two year outcomes. J Pediatr. 2014; 165(1):30-35.e2. DOI: 10.1016/j.jpeds.2014.01.017. View