Shoulder Instability: Interobserver and Intraobserver Agreement in the Assessment of Labral Tears

Overview

Journal Orthop J Sports Med

Specialty Orthopedics

Date 2018 Sep 12

PMID 30202768

Citations 1

Authors

Brian R Wolf

Bastian Uribe

Carolyn M Hettrich

Yubo Gao

Morgan Johnson

John E Kuhn

Charles L Cox

Brian T Feely

Julie Bishop

Grant Jones

Robert H Brophy

Matthew V Smith

Keith M Baumgarten

Edwin E Spencer

Affiliations

Soon will be listed here.

Abstract

Background: The glenohumeral joint combines large range of motion and insufficient bony stabilization, making it susceptible to instability and dislocations. Arthroscopic surgery is routinely used as a diagnostic tool and has been considered the gold standard for the diagnosis of shoulder lesions. However, several studies have demonstrated variability in intraobserver and interobserver agreement.

Purpose: To evaluate interobserver and intraobserver agreement in the assessment of intra-articular lesions associated with shoulder instability among fellowship-trained shoulder surgeons.

Study Design: Cohort study (diagnosis); Level of evidence, 3.

Methods: A total of 24 arthroscopic videos from patients treated for recurrent shoulder instability were shown to a group of 10 fellowship-trained shoulder surgeons who are members of the Multicenter Orthopaedic Outcomes Network (MOON) Shoulder Group. They were presented to the surgeons on 2 different occasions at least 2 months apart. They were asked to classify labral tears by their position, type, extension, other intra-articular abnormality, and preferred treatment. No patient history or physical examination data were provided. The primary outcome was the median overall percentage of agreement for the surgeons performing a video review, measured for each variable evaluated. Intraclass correlation coefficients were used to evaluate continuous variables, and kappa values were used for categorical items.

Results: Interobserver agreement was good for anterior labral lesions; good for Hill-Sachs lesions; and moderate for lesions of the superior labrum, posterior labrum, anterior sublabral foramen, and position and extension of the tear. Intraobserver agreement was either good or very good for all variables evaluated, except for being poor for inferior labral lesions and moderate for lesions of the meniscoid superior labrum.

Conclusion: Interobserver and intraobserver reliability for the arthroscopic assessment of labral tears in patients with recurrent shoulder instability were good to moderate for the majority of anatomic structures assessed. There was relatively good agreement between shoulder instability surgeons on assessing and documenting shoulder instability-associated abnormalities. These findings are important when interpreting collaborative clinical cohort studies with numerous surgeons involved in the research.

Citing Articles

Intraobserver and Interobserver Reliability of the Snyder and Expanded SLAP Classification System: A Video Study.

Hahn A, Holmberg K, Hammarstedt J, Philp F, DeMeo P, Lai V Orthop J Sports Med. 2023; 11(11):23259671231204851.

PMID: 37954863 PMC: 10638887. DOI: 10.1177/23259671231204851.

References

Mohtadi N, Jager F, Sasyniuk T, Hollinshead R, Fick G . The reliability between surgeons comparing arthroscopic and video evaluation of patients with shoulder impingement syndrome. Arthroscopy. 2004; 20(10):1055-62. DOI: 10.1016/j.arthro.2004.08.016. View

Kneisl J, SWEENEY H, Paige M . Correlation of pathology observed in double contrast arthrotomography and arthroscopy of the shoulder. Arthroscopy. 1988; 4(1):21-4. DOI: 10.1016/s0749-8063(88)80006-9. View

Loehr S, Pope Jr T, Martin D, Link K, Monu J, Hunter M . Three-dimensional MRI of the glenoid labrum. Skeletal Radiol. 1995; 24(2):117-21. DOI: 10.1007/BF00198073. View

Zacchilli M, Owens B . Epidemiology of shoulder dislocations presenting to emergency departments in the United States. J Bone Joint Surg Am. 2010; 92(3):542-9. DOI: 10.2106/JBJS.I.00450. View

Huylebroek J, Van Hedent E, van Overschelde J . Correlation of computed arthrotomography with arthroscopy of the glenohumeral joint. Acta Orthop Belg. 1991; 57 Suppl 1:83-8. View

Tischer T, Vogt S, Kreuz P, Imhoff A . Arthroscopic anatomy, variants, and pathologic findings in shoulder instability. Arthroscopy. 2011; 27(10):1434-43. DOI: 10.1016/j.arthro.2011.05.017. View

Cicchetti D, Feinstein A . High agreement but low kappa: II. Resolving the paradoxes. J Clin Epidemiol. 1990; 43(6):551-8. DOI: 10.1016/0895-4356(90)90159-m. View

Hunter J, Blatz D, Escobedo E . SLAP lesions of the glenoid labrum: CT arthrographic and arthroscopic correlation. Radiology. 1992; 184(2):513-8. DOI: 10.1148/radiology.184.2.1620857. View

Gobezie R, Zurakowski D, Lavery K, Millett P, Cole B, Warner J . Analysis of interobserver and intraobserver variability in the diagnosis and treatment of SLAP tears using the Snyder classification. Am J Sports Med. 2008; 36(7):1373-9. DOI: 10.1177/0363546508314795. View

10.

Sasyniuk T, Mohtadi N, Hollinshead R, Russell M, Fick G . The inter-rater reliability of shoulder arthroscopy. Arthroscopy. 2007; 23(9):971-7. DOI: 10.1016/j.arthro.2007.03.005. View

11.

Quinn S, Brown T . Meniscal tears diagnosed with MR imaging versus arthroscopy: how reliable a standard is arthroscopy?. Radiology. 1991; 181(3):843-7. DOI: 10.1148/radiology.181.3.1947108. View

12.

Imhoff A, Hodler J . Correlation of MR imaging, CT arthrography, and arthroscopy of the shoulder. Bull Hosp Jt Dis. 1996; 54(3):146-52. View

13.

Kirkley A, Litchfield R, Thain L, Spouge A . Agreement between magnetic resonance imaging and arthroscopic evaluation of the shoulder joint in primary anterior dislocation of the shoulder. Clin J Sport Med. 2003; 13(3):148-51. DOI: 10.1097/00042752-200305000-00004. View

14.

Wolf B, Britton C, Vasconcellos D, Spencer E . Agreement in the classification and treatment of the superior labrum. Am J Sports Med. 2011; 39(12):2588-94. DOI: 10.1177/0363546511422869. View

15.

Chandnani V, Yeager T, DeBerardino T, Christensen K, Gagliardi J, Heitz D . Glenoid labral tears: prospective evaluation with MRI imaging, MR arthrography, and CT arthrography. AJR Am J Roentgenol. 1993; 161(6):1229-35. DOI: 10.2214/ajr.161.6.8249731. View

16.

Mohtadi N, Vellet A, Clark M, Hollinshead R, Sasyniuk T, Fick G . A prospective, double-blind comparison of magnetic resonance imaging and arthroscopy in the evaluation of patients presenting with shoulder pain. J Shoulder Elbow Surg. 2004; 13(3):258-65. DOI: 10.1016/j.jse.2004.01.003. View

17.

Feinstein A, Cicchetti D . High agreement but low kappa: I. The problems of two paradoxes. J Clin Epidemiol. 1990; 43(6):543-9. DOI: 10.1016/0895-4356(90)90158-l. View

18.

Taylor D, Arciero R . Pathologic changes associated with shoulder dislocations. Arthroscopic and physical examination findings in first-time, traumatic anterior dislocations. Am J Sports Med. 1997; 25(3):306-11. DOI: 10.1177/036354659702500306. View