Methods to Improve Reliability of Video-recorded Behavioral Data

Overview

Journal Res Nurs Health

Specialties Health Services
Nursing
Public Health

Date 2009 May 13

PMID 19434651

Citations 49

Authors

Kim Kopenhaver Haidet

Judith Tate

Dana DiVirgilio-Thomas

Ann Kolanowski

Mary Beth Happ

Affiliations

Soon will be listed here.

Abstract

Behavioral observation is a fundamental component of nursing practice and a primary source of clinical research data. The use of video technology in behavioral research offers important advantages to nurse scientists in assessing complex behaviors and relationships between behaviors. The appeal of using this method should be balanced, however, by an informed approach to reliability issues. In this article, we focus on factors that influence reliability, such as the use of sensitizing sessions to minimize participant reactivity and the importance of training protocols for video coders. In addition, we discuss data quality, the selection and use of observational tools, calculating reliability coefficients, and coding considerations for special populations based on our collective experiences across three different populations and settings.

Citing Articles

Integrating competency-based, interprofessional teamwork education for students: guiding principles to support current needs and future directions.

Williams K, Lazzara E, Hernandez J, Klocko D, Chandran N, Paquette S Front Med (Lausanne). 2025; 11():1490282.

PMID: 39839636 PMC: 11748182. DOI: 10.3389/fmed.2024.1490282.

Integrating behavioral assessment in instructional design for competency-based medical education.

Williams K, Lazzara E, Sadighi M, Chandran N, Joshi K, Raj S Front Med (Lausanne). 2024; 11:1432319.

PMID: 39219797 PMC: 11361929. DOI: 10.3389/fmed.2024.1432319.

Sources of Sound Exposure in Pediatric Critical Care.

Kalvas L, Harrison T Am J Crit Care. 2024; 33(3):202-209.

PMID: 38688851 PMC: 11403585. DOI: 10.4037/ajcc2024688.

Interrater Agreement between Bedside and Video Raters Using the CPOT-Neuro for Pain Assessment in Critically Ill Patients with a Brain Injury.

Nguyen V, Richard-Lalonde M, Gelinas C Nurs Rep. 2024; 14(1):212-219.

PMID: 38391062 PMC: 10885079. DOI: 10.3390/nursrep14010017.

Screen time and sleep duration in pediatric critical care: Secondary analysis of a pilot observational study.

Kalvas L, Harrison T J Pediatr Nurs. 2024; 76:e101-e108.

PMID: 38307758 PMC: 11081838. DOI: 10.1016/j.pedn.2024.01.025.

References

Hurley A, Volicer B, Hanrahan P, Houde S, Volicer L . Assessment of discomfort in advanced Alzheimer patients. Res Nurs Health. 1992; 15(5):369-77. DOI: 10.1002/nur.4770150506. View

Latvala E, Vuokila-Oikkonen P, Janhonen S . Videotaped recording as a method of participant observation in psychiatric nursing research. J Adv Nurs. 2000; 31(5):1252-7. DOI: 10.1046/j.1365-2648.2000.01383.x. View

Caldwell K, Atwal A . Non-participant observation: using video tapes to collect data in nursing research. Nurse Res. 2006; 13(2):42-54. DOI: 10.7748/nr2005.10.13.2.42.c5967. View

Dijkstra B, Zijlstra W, Scherder E, Kamsma Y . Detection of walking periods and number of steps in older adults and patients with Parkinson's disease: accuracy of a pedometer and an accelerometry-based method. Age Ageing. 2008; 37(4):436-41. DOI: 10.1093/ageing/afn097. View

Phillips L, Morrison E, Chae Y . The QUALCARE Scale: developing an instrument to measure quality of home care. Int J Nurs Stud. 1990; 27(1):61-75. DOI: 10.1016/0020-7489(90)90024-d. View

Hunt A, Wisbeach A, Seers K, Goldman A, Crichton N, Perry L . Development of the paediatric pain profile: role of video analysis and saliva cortisol in validating a tool to assess pain in children with severe neurological disability. J Pain Symptom Manage. 2007; 33(3):276-89. DOI: 10.1016/j.jpainsymman.2006.08.011. View

Washington C, Moss M . Pragmatic aspects of establishing interrater reliability in research. Nurs Res. 1988; 37(3):190-1. View

Laschinger H . Intraclass correlations as estimates of interrater reliability in nursing research. West J Nurs Res. 1992; 14(2):246-51. DOI: 10.1177/019394599201400213. View

Heacock P, Souder E, Chastain J . Subjects, data, and videotapes. Nurs Res. 1996; 45(6):336-8. DOI: 10.1097/00006199-199611000-00005. View

10.

Landis J, Koch G . The measurement of observer agreement for categorical data. Biometrics. 1977; 33(1):159-74. View

11.

Sloane P, Miller L, Mitchell C, Rader J, Swafford K, Hiatt S . Provision of morning care to nursing home residents with dementia: opportunity for improvement?. Am J Alzheimers Dis Other Demen. 2007; 22(5):369-77. PMC: 10846029. DOI: 10.1177/1533317507305593. View

12.

Ballantyne M, Stevens B, McAllister M, Dionne K, Jack A . Validation of the premature infant pain profile in the clinical setting. Clin J Pain. 2000; 15(4):297-303. DOI: 10.1097/00002508-199912000-00006. View

13.

Hunt A, Goldman A, Seers K, Crichton N, Mastroyannopoulou K, Moffat V . Clinical validation of the paediatric pain profile. Dev Med Child Neurol. 2004; 46(1):9-18. DOI: 10.1017/s0012162204000039. View

14.

Cambron J, Evans R . Research assistants' perspective of clinical trials: results of a focus group. J Manipulative Physiol Ther. 2003; 26(5):287-92. DOI: 10.1016/S0161-4754(03)00044-7. View

15.

Warden V, Hurley A, Volicer L . Development and psychometric evaluation of the Pain Assessment in Advanced Dementia (PAINAD) scale. J Am Med Dir Assoc. 2003; 4(1):9-15. DOI: 10.1097/01.JAM.0000043422.31640.F7. View

16.

Chang V, Hwang S, Feuerman M, Kasimis B, Thaler H . The memorial symptom assessment scale short form (MSAS-SF). Cancer. 2000; 89(5):1162-71. DOI: 10.1002/1097-0142(20000901)89:5<1162::aid-cncr26>3.0.co;2-y. View

17.

Happ M, Sereika S, Garrett K, Tate J . Use of the quasi-experimental sequential cohort design in the Study of Patient-Nurse Effectiveness with Assisted Communication Strategies (SPEACS). Contemp Clin Trials. 2008; 29(5):801-8. PMC: 2570317. DOI: 10.1016/j.cct.2008.05.010. View

18.

Gross D . Issues related to validity of videotaped observational data. West J Nurs Res. 1991; 13(5):658-63. DOI: 10.1177/019394599101300511. View

19.

Kolanowski A, Hoffman L, Hofer S . Concordance of self-report and informant assessment of emotional well-being in nursing home residents with dementia. J Gerontol B Psychol Sci Soc Sci. 2007; 62(1):P20-7. DOI: 10.1093/geronb/62.1.p20. View

20.

Peters J, Koot H, Grunau R, de Boer J, van Druenen M, Tibboel D . Neonatal Facial Coding System for assessing postoperative pain in infants: item reduction is valid and feasible. Clin J Pain. 2003; 19(6):353-63. DOI: 10.1097/00002508-200311000-00003. View