Rectal MRI Radiomics Inter- and Intra-reader Reliability: Should We Worry About That?

Overview

Journal Abdom Radiol (NY)

Publisher Springer

Specialties Gastroenterology
Radiology

Date 2022 Apr 2

PMID 35366088

Authors

Henry C Kwok

Charlotte Charbel

Sofia Danilova

Joao Miranda

Natalie Gangai

Iva Petkovska

Jayasree Chakraborty

Natally Horvat

Affiliations

Soon will be listed here.

Abstract

Purpose: The aim of this review paper is to summarize the current literature regarding inter- and intra-reader reliability of radiomics on rectal MRI.

Methods: Original studies examining treatment response prediction in patients with rectal cancer following neoadjuvant therapy using rectal MRI-based radiomics between January 2010 and December 2021 were identified via a PubMed/Medline search. Studies in which intra- and/or inter-reader reliability had been reported were included in this review.

Results: Thirteen studies were selected, with an average number of patients of 145 (range, 20-649). All included studies evaluated T2-weighted imaging (T2WI) and/or diffusion-weighted imaging (DWI) sequences, while 3/13 (23%) also evaluated the contrast-enhanced T1-weighted imaging (T1WI) sequence. Most of the selected studies involved two readers (10/13, 77%), 6/13 (46%) studies used baseline MRI only, 1/13 (8%) study used restaging MRI only, and 6/13 (46%) used both. Segmentation was performed manually in 10/13 (77%) studies, and in a slight majority of studies (7/13, 54%), the entire tumor volume (3D VOI) was segmented, while 4/13 (31%) studies segmented the 2D ROI and 2/13 (15%) segmented both. Intraclass correlation coefficient (ICC) on intra-reader agreement varied from 0.73 to 0.93. ICC to assess inter-reader varied from 0.60 to 0.99. Overall, features obtained from baseline rectal MRI, using 3D VOI and first-order features, had higher agreement.

Conclusion: Based on our qualitative assessment of a small number of non-dedicated studies, there seems to be good reliability, particularly among low-order features extracted from the entire tumor volume using baseline MRI; however, direct evidence remains scarce. More targeted research in this area is required to quantitatively verify reliability, and before these novel radiomic techniques can be clinically adopted.

References

Maas M, Beets-Tan R, Lambregts D, Lammering G, Nelemans P, Engelen S . Wait-and-see policy for clinical complete responders after chemoradiation for rectal cancer. J Clin Oncol. 2011; 29(35):4633-40. DOI: 10.1200/JCO.2011.37.7176. View

Renehan A, Malcomson L, Emsley R, Gollins S, Maw A, Myint A . Watch-and-wait approach versus surgical resection after chemoradiotherapy for patients with rectal cancer (the OnCoRe project): a propensity-score matched cohort analysis. Lancet Oncol. 2015; 17(2):174-183. DOI: 10.1016/S1470-2045(15)00467-2. View

Kasi A, Abbasi S, Handa S, Al-Rajabi R, Saeed A, Baranda J . Total Neoadjuvant Therapy vs Standard Therapy in Locally Advanced Rectal Cancer: A Systematic Review and Meta-analysis. JAMA Netw Open. 2020; 3(12):e2030097. PMC: 7745099. DOI: 10.1001/jamanetworkopen.2020.30097. View

Guillem J, Chessin D, Shia J, Moore H, Mazumdar M, Bernard B . Clinical examination following preoperative chemoradiation for rectal cancer is not a reliable surrogate end point. J Clin Oncol. 2005; 23(15):3475-9. DOI: 10.1200/JCO.2005.06.114. View

Kawai K, Ishihara S, Nozawa H, Hata K, Kiyomatsu T, Morikawa T . Prediction of Pathological Complete Response Using Endoscopic Findings and Outcomes of Patients Who Underwent Watchful Waiting After Chemoradiotherapy for Rectal Cancer. Dis Colon Rectum. 2017; 60(4):368-375. DOI: 10.1097/DCR.0000000000000742. View

Kim S, Lee J, Park H, Eun H, Han J, Choi B . Accuracy of MRI for predicting the circumferential resection margin, mesorectal fascia invasion, and tumor response to neoadjuvant chemoradiotherapy for locally advanced rectal cancer. J Magn Reson Imaging. 2009; 29(5):1093-101. DOI: 10.1002/jmri.21742. View

Cusumano D, Meijer G, Lenkowicz J, Chiloiro G, Boldrini L, Masciocchi C . A field strength independent MR radiomics model to predict pathological complete response in locally advanced rectal cancer. Radiol Med. 2020; 126(3):421-429. PMC: 7937600. DOI: 10.1007/s11547-020-01266-z. View

Horvat N, Miranda J, El Homsi M, Peoples J, Long N, Simpson A . A primer on texture analysis in abdominal radiology. Abdom Radiol (NY). 2021; 47(9):2972-2985. DOI: 10.1007/s00261-021-03359-3. View

Rizzo S, Botta F, Raimondi S, Origgi D, Fanciullo C, Morganti A . Radiomics: the facts and the challenges of image analysis. Eur Radiol Exp. 2018; 2(1):36. PMC: 6234198. DOI: 10.1186/s41747-018-0068-z. View

10.

Lubner M, Smith A, Sandrasegaran K, Sahani D, Pickhardt P . CT Texture Analysis: Definitions, Applications, Biologic Correlates, and Challenges. Radiographics. 2017; 37(5):1483-1503. DOI: 10.1148/rg.2017170056. View

11.

Bashir U, Siddique M, Mclean E, Goh V, Cook G . Imaging Heterogeneity in Lung Cancer: Techniques, Applications, and Challenges. AJR Am J Roentgenol. 2016; 207(3):534-43. DOI: 10.2214/AJR.15.15864. View

12.

Li Z, Wang X, Li M, Liu X, Ye Z, Song B . Multi-modal radiomics model to predict treatment response to neoadjuvant chemotherapy for locally advanced rectal cancer. World J Gastroenterol. 2020; 26(19):2388-2402. PMC: 7243642. DOI: 10.3748/wjg.v26.i19.2388. View

13.

Schurink N, van Kranen S, Roberti S, van Griethuysen J, Bogveradze N, Castagnoli F . Sources of variation in multicenter rectal MRI data and their effect on radiomics feature reproducibility. Eur Radiol. 2021; 32(3):1506-1516. PMC: 8831294. DOI: 10.1007/s00330-021-08251-8. View

14.

Aker M, Ganeshan B, Afaq A, Wan S, Groves A, Arulampalam T . Magnetic Resonance Texture Analysis in Identifying Complete Pathological Response to Neoadjuvant Treatment in Locally Advanced Rectal Cancer. Dis Colon Rectum. 2018; 62(2):163-170. DOI: 10.1097/DCR.0000000000001224. View

15.

Cui Y, Yang X, Shi Z, Yang Z, Du X, Zhao Z . Radiomics analysis of multiparametric MRI for prediction of pathological complete response to neoadjuvant chemoradiotherapy in locally advanced rectal cancer. Eur Radiol. 2018; 29(3):1211-1220. DOI: 10.1007/s00330-018-5683-9. View

16.

Meng X, Xia W, Xie P, Zhang R, Li W, Wang M . Preoperative radiomic signature based on multiparametric magnetic resonance imaging for noninvasive evaluation of biological characteristics in rectal cancer. Eur Radiol. 2018; 29(6):3200-3209. DOI: 10.1007/s00330-018-5763-x. View

17.

Liu Z, Zhang X, Shi Y, Wang L, Zhu H, Tang Z . Radiomics Analysis for Evaluation of Pathological Complete Response to Neoadjuvant Chemoradiotherapy in Locally Advanced Rectal Cancer. Clin Cancer Res. 2017; 23(23):7253-7262. DOI: 10.1158/1078-0432.CCR-17-1038. View

18.

Choi M, Oh S, Eun Rha S, Choi J, Lee S, Jang H . Diffusion-weighted imaging: Apparent diffusion coefficient histogram analysis for detecting pathologic complete response to chemoradiotherapy in locally advanced rectal cancer. J Magn Reson Imaging. 2015; 44(1):212-20. DOI: 10.1002/jmri.25117. View

19.

Nougaret S, Vargas H, Lakhman Y, Sudre R, Do R, Bibeau F . Intravoxel Incoherent Motion-derived Histogram Metrics for Assessment of Response after Combined Chemotherapy and Radiation Therapy in Rectal Cancer: Initial Experience and Comparison between Single-Section and Volumetric Analyses. Radiology. 2016; 280(2):446-54. PMC: 4976464. DOI: 10.1148/radiol.2016150702. View

20.

Yang C, Jiang Z, Liu L, Zeng M . Pre-treatment ADC image-based random forest classifier for identifying resistant rectal adenocarcinoma to neoadjuvant chemoradiotherapy. Int J Colorectal Dis. 2019; 35(1):101-107. DOI: 10.1007/s00384-019-03455-3. View