Inter-observer and Intra-observer Reliability Between Manual Segmentation and Semi-automated Segmentation for Carotid Vessel Wall Volume Measurements on Three-dimensional Ultrasonography

Overview

Journal Ultrasonography

Date 2023 Mar 20

PMID 36935603

Authors

Chun Wai Chan

Sze Chai Christy Chow

Man Hei Kwok

Ka Ching Tiffany Ngan

Tsun Hei Or

Simon Takadiyi Gunda

Michael Ying

Affiliations

Soon will be listed here.

Abstract

Purpose: Carotid vessel wall volume (VWV) measurement on three-dimensional ultrasonography (3DUS) outperforms conventional two-dimensional ultrasonography for carotid atherosclerosis evaluation. Although time-saving semi-automated algorithms have been introduced, their clinical availability remains limited due to a lack of validation, particularly an extensive reliability analysis. This study compared inter-observer and intra-observer reliability between manual segmentation and semi-automated segmentation for carotid VWV measurements on 3DUS.

Methods: Thirty-one 3DUS volume datasets were prospectively acquired from 20 healthy subjects, aged >18 years, without previous stroke, transient ischemic attack, or cardiovascular disease. Five observers segmented all volume datasets both manually and semi-automatically. The process was repeated five times. Reliability was expressed by the intraclass correlation coefficient, supplemented by the coefficient of variation.

Results: Carotid VWV measurements using the common carotid artery (CCA) were more reliable than those using the internal carotid artery (ICA) or external carotid artery (ECA) for both manual and semiautomated segmentation (manual segmentation, CCA: inter-observer, 0.935; intra-observer, 0.934 to 0.966; ICA: inter-observer, 0.784; intra-observer, 0.756 to 0.878; ECA: inter-observer, 0.732; intraobserver, 0.919 to 0.962; semi-automated segmentation, CCA: inter-observer, 0.986; intra-observer, 0.954 to 0.993; ICA: inter-observer, 0.977; intra-observer, 0.958 to 0.978; ECA: inter-observer, 0.966; intra-observer, 0.884 to 0.937). Total carotid VWV measurements by manual (inter-observer, 0.922; intra-observer, 0.927 to 0.961) and semi-automated segmentation (inter-observer, 0.987; intra-observer, 0.968 to 0.989) were highly reliable. Semi-automated segmentation showed higher reliability than manual segmentation for both individual and total carotid VWV measurements.

Conclusion: 3DUS carotid VWV measurements of the CCA are more reliable than measurements of the ICA and ECA. Total carotid VWV measurements are highly reliable. Semi-automated segmentation has higher reliability than manual segmentation.

Citing Articles

Interobserver Variability in Manual Versus Semi-Automatic CT Assessments of Small Lung Nodule Diameter and Volume.

Zacharias F, Svahn T Tomography. 2024; 10(12):2087-2099.

PMID: 39728910 PMC: 11680079. DOI: 10.3390/tomography10120148.

References

Browne J, Watson A, Hoskins P, Elliott A . Investigation of the effect of subcutaneous fat on image quality performance of 2D conventional imaging and tissue harmonic imaging. Ultrasound Med Biol. 2005; 31(7):957-64. DOI: 10.1016/j.ultrasmedbio.2005.03.012. View

Kobayashi K, Kishi M, Atsumi T, Bertolaccini M, Makino H, Sakairi N . Circulating oxidized LDL forms complexes with beta2-glycoprotein I: implication as an atherogenic autoantigen. J Lipid Res. 2003; 44(4):716-26. DOI: 10.1194/jlr.M200329-JLR200. View

Roger V, Go A, Lloyd-Jones D, Benjamin E, Berry J, Borden W . Heart disease and stroke statistics--2012 update: a report from the American Heart Association. Circulation. 2011; 125(1):e2-e220. PMC: 4440543. DOI: 10.1161/CIR.0b013e31823ac046. View

Heliopoulos J, Vadikolias K, Piperidou C, Mitsias P . Detection of carotid artery plaque ulceration using 3-dimensional ultrasound. J Neuroimaging. 2009; 21(2):126-31. DOI: 10.1111/j.1552-6569.2009.00450.x. View

Goldstein A . Errors in ultrasound digital image distance measurements. Ultrasound Med Biol. 2000; 26(7):1125-32. DOI: 10.1016/s0301-5629(00)00249-0. View

Khan A, Koudelka C, Goldstein C, Zhao L, Yokemick J, Dux M . Semiautomatic quantification of carotid plaque volume with three-dimensional ultrasound imaging. J Vasc Surg. 2017; 65(5):1407-1417. DOI: 10.1016/j.jvs.2016.11.033. View

Spence J . Approaching Automated 3-Dimensional Measurement of Atherosclerotic Plaque Volume. J Am Coll Cardiol. 2017; 70(3):314-317. DOI: 10.1016/j.jacc.2017.05.036. View

Libby P . Inflammation in atherosclerosis. Nature. 2002; 420(6917):868-74. DOI: 10.1038/nature01323. View

Hennerici M, Baezner H, Daffertshofer M . Ultrasound and arterial wall disease. Cerebrovasc Dis. 2003; 17 Suppl 1:19-33. DOI: 10.1159/000074792. View

10.

Sillesen H, Sartori S, Sandholt B, Baber U, Mehran R, Fuster V . Carotid plaque thickness and carotid plaque burden predict future cardiovascular events in asymptomatic adult Americans. Eur Heart J Cardiovasc Imaging. 2017; 19(9):1042-1050. DOI: 10.1093/ehjci/jex239. View

11.

STARY H, Blankenhorn D, Chandler A, Glagov S, INSULL Jr W, Richardson M . A definition of the intima of human arteries and of its atherosclerosis-prone regions. A report from the Committee on Vascular Lesions of the Council on Arteriosclerosis, American Heart Association. Circulation. 1992; 85(1):391-405. DOI: 10.1161/01.cir.85.1.391. View

12.

Ukwatta E, Awad J, Ward A, Buchanan D, Samarabandu J, Parraga G . Three-dimensional ultrasound of carotid atherosclerosis: semiautomated segmentation using a level set-based method. Med Phys. 2011; 38(5):2479-93. DOI: 10.1118/1.3574887. View

13.

Spence J . Ultrasound measurement of carotid plaque as a surrogate outcome for coronary artery disease. Am J Cardiol. 2002; 89(4A):10B-15B; discussion 15B-16B. DOI: 10.1016/s0002-9149(01)02327-x. View

14.

Picot P, Rickey D, Mitchell R, Rankin R, Fenster A . Three-dimensional colour Doppler imaging. Ultrasound Med Biol. 1993; 19(2):95-104. DOI: 10.1016/0301-5629(93)90001-5. View

15.

Johri A, Nambi V, Naqvi T, Feinstein S, Kim E, Park M . Recommendations for the Assessment of Carotid Arterial Plaque by Ultrasound for the Characterization of Atherosclerosis and Evaluation of Cardiovascular Risk: From the American Society of Echocardiography. J Am Soc Echocardiogr. 2020; 33(8):917-933. DOI: 10.1016/j.echo.2020.04.021. View

16.

Mughal M, Khan M, DeMarco J, Majid A, Shamoun F, Abela G . Symptomatic and asymptomatic carotid artery plaque. Expert Rev Cardiovasc Ther. 2011; 9(10):1315-30. PMC: 3243497. DOI: 10.1586/erc.11.120. View

17.

Eicke B, von Lorentz J, Paulus W . Embolus detection in different degrees of carotid disease. Neurol Res. 1995; 17(3):181-4. DOI: 10.1080/01616412.1995.11740309. View

18.

Hossain M, AlMuhanna K, Zhao L, Lal B, Sikdar S . Semiautomatic segmentation of atherosclerotic carotid artery wall volume using 3D ultrasound imaging. Med Phys. 2015; 42(4):2029-43. DOI: 10.1118/1.4915925. View

19.

Donnan G, Fisher M, Macleod M, Davis S . Stroke. Lancet. 2008; 371(9624):1612-23. DOI: 10.1016/S0140-6736(08)60694-7. View

20.

Barth J . Carotid intima media thickness and beyond. Curr Drug Targets Cardiovasc Haematol Disord. 2004; 4(2):129-45. DOI: 10.2174/1568006043336339. View