Alpha 2.0
Login Register
» Articles » PMID: 16795538

Considerations in the Choice of Interobserver Reliability Estimates

Overview
Journal J Appl Behav Anal
Specialty Social Sciences
Date 1977 Apr 1
PMID 16795538
Citations 108
Authors
D P Hartmann
Affiliations
Soon will be listed here.
Abstract

Two types of interobserver reliability values may be needed in treatment studies in which observers constitute the primary data-acquisition system: trial reliability and the reliability of the composite unit or score which is subsequently analyzed, e.g., daily or weekly session totals. Two approaches to determining interobserver reliability are described: percentage agreement and "correlational" measures of reliability. The interpretation of these estimates, factors affecting their magnitude, and the advantages and limitations of each approach are presented.

Citing Articles

Development of and Testing Novel Questionnaires Assessing Palliative Care-Related Knowledge, Attitudes, and Confidence Among Home Healthcare Clinicians, Patients, and Caregivers.

Chastain A, Shang J, Murali K, King L, Ogunlusi C, Zhao S Home Healthc Now. 2025; 43(1):21-31.

PMID: 39763039 PMC: 11723490. DOI: 10.1097/NHH.0000000000001316.

Investigating skeletal fracture patterns in truck occupants involved in fatal motor vehicle incidents.

Wulff A, Dipnall J, Fernandez R, Cheshire E, Biggs M, de Boer H Int J Legal Med. 2024; 139(2):901-915.

PMID: 39579254 DOI: 10.1007/s00414-024-03372-3.

Cross-cultural adaptation and test-retest reliability assessment of a Swedish version of the exercise adherence rating scale in patients after shoulder surgery.

Soderberg J, Sallfeldt E, Ribom E, Urell C Ann Med. 2024; 56(1):2409962.

PMID: 39351706 PMC: 11445904. DOI: 10.1080/07853890.2024.2409962.

Standardised and automated assessment of head computed tomography reliably predicts poor functional outcome after cardiac arrest: a prospective multicentre study.

Lang M, Kenda M, Scheel M, Martola J, Wheeler M, Owen S Intensive Care Med. 2024; 50(7):1096-1107.

PMID: 38900283 PMC: 11245448. DOI: 10.1007/s00134-024-07497-2.

Early Adolescents' Social Goals in Peer Conflict Situations: A Mixed Methods Study.

Dunn C, Pittman S, Mehari K, Titchner D, Farrell A J Early Adolesc. 2023; 42(5):647-670.

PMID: 37736490 PMC: 10512817. DOI: 10.1177/02724316211064516.

References
1.
Wahler R . Some structural aspects of deviant child behavior. J Appl Behav Anal. 1975; 8(1):27-42. PMC: 1311815. DOI: 10.1901/jaba.1975.8-27. View
2.
Kazdin A, Klock J . The effect of nonverbal teacher approval on student attentive behavior. J Appl Behav Anal. 1973; 6(4):643-54. PMC: 1310882. DOI: 10.1901/jaba.1973.6-643. View
3.
Schmidt G, Ulrich R . Effects of group contingent events upon classroom noise. J Appl Behav Anal. 1969; 2(3):171-9. PMC: 1311060. DOI: 10.1901/jaba.1969.2-171. View
4.
Fleiss J . Measuring agreement between two judges on the presence or absence of a trait. Biometrics. 1975; 31(3):651-9. View