Inter- and Intra-observer Agreement of the Peripheral Arterial Calcium Scoring System in Patients Undergoing (Infra)Popliteal Endovascular Interventions

Overview

Journal Cardiovasc Intervent Radiol

Specialty Cardiology & Vascular Diseases

Date 2024 Aug 26

PMID 39187653

Authors

Michael J Nugteren

Cagdas Unlu

Morsal Samim

Hester J Scheffer

Gert J de Borst

Constantijn E V B Hazenberg

Affiliations

Soon will be listed here.

Abstract

Purpose: Peripheral arterial calcification is an important predictor of outcomes after both conservative and endovascular treatment. Digital subtraction angiography (DSA)-based calcification scores are limited by low sensitivity and inter-observer agreement. The Peripheral Arterial Calcium Scoring System (PACSS) assesses the severity of target lesion calcification. The newly introduced modified PACSS (mPACSS) also evaluates target vessel calcification. This study aimed to assess the inter- and intra-observer reliability of PACSS and mPACSS on computed tomography angiography (CTA) in (infra)popliteal endovascular interventions.

Methods: A random sample of 50 limbs from the prospective multicenter Dutch Chronic Lower Limb-Threatening Ischemia Registry (THRILLER) were included. Three experienced independent raters scored PACSS on CTA. Three months later, one blinded rater assessed the same 50 CTA scans, keeping track of assessment time. The reliability of the original 5-step PACSS, a simplified binary PACSS (0-2 vs 3-4) and the 7-step mPACSS were tested using Cohen's and Fleiss' kappa statistics.

Results: In total, 50 limbs (mean age 70.1 ± 11.0, 29 men) with 41 popliteal and 40 infrapopliteal lesions were scored. Inter-observer agreement of PACSS and binary PACSS were moderate (κ = 0.60) and substantial (κ = 0.72), respectively, while intra-observer agreement was almost perfect in both scores (κ = 0.86). Inter- and intra-observer agreement of mPACSS were moderate (κ = 0.48) and substantial (κ = 0.77), respectively. Mean assessment time for an experienced rater was 3.43 ± 0.93 min per CTA scan.

Conclusion: Both the semi-quantitative PACSS and mPACSS scores for (infra)popliteal arteries can be performed reliably on pre-operative CTA.

References

Song P, Rudan D, Zhu Y, Fowkes F, Rahimi K, Fowkes F . Global, regional, and national prevalence and risk factors for peripheral artery disease in 2015: an updated systematic review and analysis. Lancet Glob Health. 2019; 7(8):e1020-e1030. DOI: 10.1016/S2214-109X(19)30255-4. View

Baumann F, Engelberger R, Willenberg T, Do D, Kalka C, Baumgartner I . Infrapopliteal lesion morphology in patients with critical limb ischemia: implications for the development of anti-restenosis technologies. J Endovasc Ther. 2013; 20(2):149-56. DOI: 10.1583/1545-1550-20.2.149. View

Rocha-Singh K, Zeller T, Jaff M . Peripheral arterial calcification: prevalence, mechanism, detection, and clinical implications. Catheter Cardiovasc Interv. 2014; 83(6):E212-20. PMC: 4262070. DOI: 10.1002/ccd.25387. View

Huang C, Wu I, Wu Y, Hwang J, Wang S, Chen W . Association of lower extremity arterial calcification with amputation and mortality in patients with symptomatic peripheral artery disease. PLoS One. 2014; 9(2):e90201. PMC: 3936008. DOI: 10.1371/journal.pone.0090201. View

Kang I, Lee W, Choi B, Choi D, Hong M, Jang Y . Semiquantitative assessment of tibial artery calcification by computed tomography angiography and its ability to predict infrapopliteal angioplasty outcomes. J Vasc Surg. 2016; 64(5):1335-1343. DOI: 10.1016/j.jvs.2016.04.047. View

Konijn L, Takx R, de Jong P, Spreen M, Veger H, PThM Mali W . Arterial calcification and long-term outcome in chronic limb-threatening ischemia patients. Eur J Radiol. 2020; 132:109305. DOI: 10.1016/j.ejrad.2020.109305. View

Tokuda T, Oba Y, Koshida R, Suzuki Y, Murata A, Ito T . The Impact of Femoropopliteal Artery Calcium Score after Endovascular Treatment. Ann Vasc Surg. 2019; 66:543-553. DOI: 10.1016/j.avsg.2019.10.081. View

Zettervall S, Marshall A, Fleser P, Guzman R . Association of arterial calcification with chronic limb ischemia in patients with peripheral artery disease. J Vasc Surg. 2017; 67(2):507-513. PMC: 6085869. DOI: 10.1016/j.jvs.2017.06.086. View

Ichihashi S, Shibata T, Fujimura N, Nagatomi S, Yamamoto H, Kyuragi R . Vessel Calcification as a Risk Factor for In-Stent Restenosis in Complex Femoropopliteal Lesions After Zilver PTX Paclitaxel-Coated Stent Placement. J Endovasc Ther. 2019; 26(5):613-620. DOI: 10.1177/1526602819860124. View

Okuno S, Iida O, Shiraki T, Fujita M, Masuda M, Okamoto S . Impact of Calcification on Clinical Outcomes After Endovascular Therapy for Superficial Femoral Artery Disease: Assessment Using the Peripheral Artery Calcification Scoring System. J Endovasc Ther. 2016; 23(5):731-7. DOI: 10.1177/1526602816656612. View

10.

Tepe G, Beschorner U, Ruether C, Fischer I, Pfaffinger P, Noory E . Drug-Eluting Balloon Therapy for Femoropopliteal Occlusive Disease: Predictors of Outcome With a Special Emphasis on Calcium. J Endovasc Ther. 2015; 22(5):727-33. DOI: 10.1177/1526602815600156. View

11.

He H, Weng J, Zhao Y, Cai S, Zhang X, Yin H . Impact of Plaque Calcification and Stent Oversizing on Clinical Outcomes of Atherosclerotic Femoropopliteal Arterial Occlusive Disease Following Stent Angioplasty. Eur J Vasc Endovasc Surg. 2019; 58(2):215-222. DOI: 10.1016/j.ejvs.2019.01.025. View

12.

Guzman R, Brinkley D, Schumacher P, Donahue R, Beavers H, Qin X . Tibial artery calcification as a marker of amputation risk in patients with peripheral arterial disease. J Am Coll Cardiol. 2008; 51(20):1967-74. PMC: 2836514. DOI: 10.1016/j.jacc.2007.12.058. View

13.

Allan R, Wise N, Wong Y, Delaney C . Accuracy and Reliability of Peripheral Artery Calcium Scoring Systems Using an Intravascular Ultrasound Reference Standard. Ann Vasc Surg. 2022; 91:233-241. DOI: 10.1016/j.avsg.2022.11.014. View

13.

Yoshioka N, Tokuda T, Koyama A, Yamada T, Nishikawa R, Shimamura K . Clinical outcomes and predictors of restenosis in patients with femoropopliteal artery disease treated using polymer-coated paclitaxel-eluting stents or drug-coated balloons. Heart Vessels. 2021; 37(4):555-566. DOI: 10.1007/s00380-021-01941-9. View

14.

Yin D, Maehara A, Shimshak T, Ricotta 2nd J, Ramaiah V, Foster 3rd M . Intravascular Ultrasound Validation of Contemporary Angiographic Scores Evaluating the Severity of Calcification in Peripheral Arteries. J Endovasc Ther. 2017; 24(4):478-487. DOI: 10.1177/1526602817708796. View

15.

Nugteren M, Hazenberg C, Akkersdijk G, Bakker O, Dinkelman M, Fioole B . The Dutch chronic lower limb-threatening ischemia registry (THRILLER): A study protocol for popliteal and infrapopliteal endovascular interventions. PLoS One. 2023; 18(7):e0288912. PMC: 10358906. DOI: 10.1371/journal.pone.0288912. View

16.

Landis J, Koch G . The measurement of observer agreement for categorical data. Biometrics. 1977; 33(1):159-74. View

17.

Tan M, Ueshima D, Urasawa K, Hayakawa N, Dannoura Y, Itoh T . Prediction of successful guidewire crossing of below-the-knee chronic total occlusions using a Japanese scoring system. J Vasc Surg. 2021; 74(2):506-513.e2. DOI: 10.1016/j.jvs.2021.01.059. View

18.

Nugteren M, Welling R, Bakker O, Unlu C, Hazenberg C . Vessel Preparation in Infrapopliteal Arterial Disease: A Systematic Review and Meta-Analysis. J Endovasc Ther. 2022; 31(2):191-202. PMC: 10938478. DOI: 10.1177/15266028221120752. View