Validity and Reliability of Methods to Assess Movement Deficiencies Following Concussion: A COSMIN Systematic Review

Overview

Journal Sports Med Open

Specialty Orthopedics

Date 2023 Aug 14

PMID 37578611

Authors

Laura A M Dunne

Michael H Cole

Stuart J Cormack

David R Howell

Rich D Johnston

Affiliations

Soon will be listed here.

Abstract

Background: There is an increased risk of subsequent concussion and musculoskeletal injury upon return to play following a sports-related concussion. Whilst there are numerous assessments available for clinicians for diagnosis and during return to play following concussion, many may lack the ability to detect these subclinical changes in function. Currently, there is no consensus or collated sources on the reliability, validity and feasibility of these assessments, which makes it difficult for clinicians and practitioners to select the most appropriate assessment for their needs.

Objectives: This systematic review aims to (1) consolidate the reliability and validity of motor function assessments across the time course of concussion management and (2) summarise their feasibility for clinicians and other end-users.

Methods: A systematic search of five databases was conducted. Eligible studies were: (1) original research; (2) full-text English language; (3) peer-reviewed with level III evidence or higher; (4) assessed the validity of lower-limb motor assessments used to diagnose or determine readiness for athletes or military personnel who had sustained a concussion or; (5) assessed the test-retest reliability of lower-limb motor assessments used for concussion management amongst healthy athletes. Acceptable lower-limb motor assessments were dichotomised into instrumented and non-instrumented and then classified into static (stable around a fixed point), dynamic (movement around a fixed point), gait, and other categories. Each study was assessed using the COSMIN checklist to establish methodological and measurement quality.

Results: A total of 1270 records were identified, with 637 duplicates removed. Titles and abstracts of 633 records were analysed, with 158 being retained for full-text review. A total of 67 records were included in this review; 37 records assessed reliability, and 35 records assessed the validity of lower-limb motor assessments. There were 42 different assessments included in the review, with 43% being non-instrumented, subjective assessments. Consistent evidence supported the use of instrumented assessments over non-instrumented, with gait-based assessments demonstrating sufficient reliability and validity compared to static or dynamic assessments.

Conclusion: These findings suggest that instrumented, gait-based assessments should be prioritised over static or dynamic balance assessments. The use of laboratory equipment (i.e. 3D motion capture, pressure sensitive walkways) on average exhibited sufficient reliability and validity, yet demonstrate poor feasibility. Further high-quality studies evaluating the reliability and validity of more readily available devices (i.e. inertial measurement units) are needed to fill the gap in current concussion management protocols. Practitioners can use this resource to understand the accuracy and precision of the assessments they have at their disposal to make informed decisions regarding the management of concussion.

Trail Registration: This systematic review was registered on PROSPERO (reg no. CRD42021256298).

Citing Articles

Post-Acute Concussion-Related Differences in Neuromotor Control Measured Using a Low-Cost Movement Assessment System: A Feasibility Study.

Thomas J, Bliss R, Fields C, Farnen T, Guess T Int J Sports Phys Ther. 2025; 20(3):392-399.

PMID: 40041526 PMC: 11872567. DOI: 10.26603/001c.129888.

References

Lininger M, Leahy T, Haug E, Bowman T . TEST-RETEST RELIABILITY OF THE LIMITS OF STABILITY TEST PERFORMED BY YOUNG ADULTS USING NEUROCOM® VSR SPORT. Int J Sports Phys Ther. 2018; 13(5):800-807. PMC: 6159502. View

Howell D, Osternig L, Chou L . Consistency and cost of dual-task gait balance measure in healthy adolescents and young adults. Gait Posture. 2016; 49:176-180. DOI: 10.1016/j.gaitpost.2016.07.008. View

Alsalaheen B, Haines J, Yorke A, Broglio S . Reliability and Construct Validity of Limits of Stability Test in Adolescents Using a Portable Forceplate System. Arch Phys Med Rehabil. 2015; 96(12):2194-200. DOI: 10.1016/j.apmr.2015.08.418. View

German D, Bahat H . Validity and Reliability of a Customized Smartphone Application for Postural Sway Assessment. J Manipulative Physiol Ther. 2022; 44(9):707-717. DOI: 10.1016/j.jmpt.2022.03.007. View

Barnes A, Smulligan K, Wingerson M, Little C, Lugade V, Wilson J . A Multifaceted Approach to Interpreting Reaction Time Deficits After Adolescent Concussion. J Athl Train. 2023; 59(2):145-152. PMC: 10895397. DOI: 10.4085/1062-6050-0566.22. View

Buckley T, Munkasy B, Clouse B . Sensitivity and Specificity of the Modified Balance Error Scoring System in Concussed Collegiate Student Athletes. Clin J Sport Med. 2017; 28(2):174-176. DOI: 10.1097/JSM.0000000000000426. View

McCulloch K, Buxton E, Hackney J, Lowers S . Balance, attention, and dual-task performance during walking after brain injury: associations with falls history. J Head Trauma Rehabil. 2010; 25(3):155-63. DOI: 10.1097/HTR.0b013e3181dc82e7. View

Hearn M, Levy S, Baweja H, Goble D . BTrackS Balance Test for Concussion Management is Resistant to Practice Effects. Clin J Sport Med. 2017; 28(2):177-179. DOI: 10.1097/JSM.0000000000000435. View

Teel E, Gay M, Arnett P, Slobounov S . Differential Sensitivity Between a Virtual Reality Balance Module and Clinically Used Concussion Balance Modalities. Clin J Sport Med. 2015; 26(2):162-6. PMC: 4767669. DOI: 10.1097/JSM.0000000000000210. View

10.

Johnston W, Coughlan G, Caulfield B . Challenging concussed athletes: the future of balance assessment in concussion. QJM. 2017; 110(12):779-783. DOI: 10.1093/qjmed/hcw228. View

11.

Schneiders A, Sullivan S, Gray A, Hammond-Tooke G, McCrory P . Normative values for three clinical measures of motor performance used in the neurological assessment of sports concussion. J Sci Med Sport. 2009; 13(2):196-201. DOI: 10.1016/j.jsams.2009.05.004. View

12.

Howell D, Lugade V, Taksir M, Meehan 3rd W . Determining the utility of a smartphone-based gait evaluation for possible use in concussion management. Phys Sportsmed. 2019; 48(1):75-80. DOI: 10.1080/00913847.2019.1632155. View

13.

Furman G, Lin C, Bellanca J, Marchetti G, Collins M, Whitney S . Comparison of the balance accelerometer measure and balance error scoring system in adolescent concussions in sports. Am J Sports Med. 2013; 41(6):1404-10. PMC: 4899870. DOI: 10.1177/0363546513484446. View

14.

Murray N, Salvatore A, Powell D, Reed-Jones R . Reliability and validity evidence of multiple balance assessments in athletes with a concussion. J Athl Train. 2014; 49(4):540-9. PMC: 4151843. DOI: 10.4085/1062-6050-49.3.32. View

15.

Resch J, Brown C, Schmidt J, Macciocchi S, Blueitt D, Cullum C . The sensitivity and specificity of clinical measures of sport concussion: three tests are better than one. BMJ Open Sport Exerc Med. 2016; 2(1):e000012. PMC: 5117030. DOI: 10.1136/bmjsem-2015-000012. View

16.

Toong T, Wilson K, Hunt A, Scratch S, DeMatteo C, Reed N . Sensitivity and Specificity of a Multimodal Approach for Concussion Assessment in Youth Athletes. J Sport Rehabil. 2021; 30(6):850-859. DOI: 10.1123/jsr.2020-0279. View

17.

Dessy A, Yuk F, Maniya A, Gometz A, Rasouli J, Lovell M . Review of Assessment Scales for Diagnosing and Monitoring Sports-related Concussion. Cureus. 2018; 9(12):e1922. PMC: 5802754. DOI: 10.7759/cureus.1922. View

18.

Pape M, Williams K, Kodosky P, Dretsch M . The Community Balance and Mobility Scale: A Pilot Study Detecting Impairments in Military Service Members With Comorbid Mild TBI and Psychological Health Conditions. J Head Trauma Rehabil. 2015; 31(5):339-45. DOI: 10.1097/HTR.0000000000000179. View

19.

Ulman S, Erdman A, Loewen A, Worrall H, Tulchin-Francis K, Jones J . Improvement in balance from diagnosis to return-to-play initiation following a sport-related concussion: BESS scores vs center-of-pressure measures. Brain Inj. 2022; 36(8):921-930. DOI: 10.1080/02699052.2022.2109736. View

20.

Howell D, Oldham J, Difabio M, Vallabhajosula S, Hall E, Ketcham C . Single-Task and Dual-Task Gait Among Collegiate Athletes of Different Sport Classifications: Implications for Concussion Management. J Appl Biomech. 2016; 33(1):24-31. DOI: 10.1123/jab.2015-0323. View