Who's Up First? Testing for Order Effects in Structured Interviews Using a Counterbalanced Experimental Design

Overview

Journal J Abnorm Child Psychol

Publisher Springer

Date 2000 May 23

PMID 10821625

Citations 24

Authors

P S Jensen

H K Watanabe

J E Richters

Affiliations

Soon will be listed here.

Abstract

A growing body of research suggests that, apart from the wording of specific questions, various aspects of the interview process itself may affect the reliability of information provided by research participants. To examine whether the order of presentation of specific diagnostic modules affects the likelihood of subjects' yes/no responses within the Diagnostic Interview Schedule for Children (DISC), the authors used a counterbalanced design, presenting two DISC diagnostic modules to children and their parents in standard or reversed order. Results indicate that the order of module administration exerts effects on the total numbers of symptoms endorsed, level of impairment, and the likelihood of meeting diagnostic criteria, regardless of whether the information is provided by parent or child respondents. Future child and adult assessment measures should take these difficulties fully into account through novel approaches to instrument design and interview procedures.

Citing Articles

Transdiagnostic Assessment of Temporal Experience (TATE) in Mental Disorders-Empirical Validation and Adaptation of a Structured Phenomenological Interview.

Szula A, Moskalewicz M, Stanghellini G J Clin Med. 2024; 13(15).

PMID: 39124592 PMC: 11313341. DOI: 10.3390/jcm13154325.

First-interview response patterns of intensive longitudinal psychological and health data.

Blozis S J Health Psychol. 2024; :13591053241235751.

PMID: 38444167 PMC: 11686926. DOI: 10.1177/13591053241235751.

Explicit and implicit attachment and the outcomes of acceptance and commitment therapy and cognitive behavioral therapy for depression.

A-Tjak J, Morina N, Boendermaker W, Topper M, Emmelkamp P BMC Psychiatry. 2020; 20(1):155.

PMID: 32264845 PMC: 7137238. DOI: 10.1186/s12888-020-02547-7.

Violent interpersonal trauma predicts aggressive thoughts and behaviors towards self and others: findings from the National Comorbidity Survey-Adolescent Supplement.

Bynion T, Cloutier R, Blumenthal H, Mischel E, Rojas S, Leen-Feldner E Soc Psychiatry Psychiatr Epidemiol. 2018; 53(12):1361-1370.

PMID: 30255381 DOI: 10.1007/s00127-018-1607-x.

Initial elevation bias in subjective reports.

Shrout P, Stadler G, Lane S, McClure M, Jackson G, Clavel F Proc Natl Acad Sci U S A. 2017; 115(1):E15-E23.

PMID: 29255039 PMC: 5776801. DOI: 10.1073/pnas.1712277115.

References

Edelbrock C, Crnic K, Bohnert A . Interviewing as communication: an alternative way of administering the Diagnostic Interview Schedule for Children. J Abnorm Child Psychol. 2000; 27(6):447-53. DOI: 10.1023/a:1021979925865. View

Pearlin L, Schooler C . The structure of coping. J Health Soc Behav. 1978; 19(1):2-21. View

Hodges K . Structured interviews for assessing children. J Child Psychol Psychiatry. 1993; 34(1):49-68. DOI: 10.1111/j.1469-7610.1993.tb00967.x. View

Shaffer D, Fisher P, Dulcan M, Davies M, Piacentini J, Lahey B . The NIMH Diagnostic Interview Schedule for Children Version 2.3 (DISC-2.3): description, acceptability, prevalence rates, and performance in the MECA Study. Methods for the Epidemiology of Child and Adolescent Mental Disorders Study. J Am Acad Child Adolesc Psychiatry. 1996; 35(7):865-77. DOI: 10.1097/00004583-199607000-00012. View

Edelbrock C, Costello A, Dulcan M, Kalas R, Conover N . Age differences in the reliability of the psychiatric interview of the child. Child Dev. 1985; 56(1):265-75. View

Kessler R, Little R, Groves R . Advances in strategies for minimizing and adjusting for survey nonresponse. Epidemiol Rev. 1995; 17(1):192-204. DOI: 10.1093/oxfordjournals.epirev.a036176. View

FALLON T, Briggs M, Crowther B . Reliability of diagnostic reporting for children aged 6-11 years: a test-retest study of the Diagnostic Interview Schedule for Children-Revised. Am J Psychiatry. 1994; 151(7):1048-54. DOI: 10.1176/ajp.151.7.1048. View

Ambrosini P, Metz C, Prabucki K, Lee J . Videotape reliability of the third revised edition of the K-SADS. J Am Acad Child Adolesc Psychiatry. 1989; 28(5):723-8. DOI: 10.1097/00004583-198909000-00013. View

CODDINGTON R . The significance of life events as etiologic factors in the diseases of children. II. A study of a normal population. J Psychosom Res. 1972; 16(3):205-13. DOI: 10.1016/0022-3999(72)90045-1. View

10.

Gould M, Bird H, Jaramillo B . Correspondence between statistically derived behavior problem syndromes and child psychiatric diagnoses in a community sample. J Abnorm Child Psychol. 1993; 21(3):287-313. DOI: 10.1007/BF00917536. View

11.

Kaufman J, Birmaher B, Brent D, Rao U, Flynn C, Moreci P . Schedule for Affective Disorders and Schizophrenia for School-Age Children-Present and Lifetime Version (K-SADS-PL): initial reliability and validity data. J Am Acad Child Adolesc Psychiatry. 1997; 36(7):980-8. DOI: 10.1097/00004583-199707000-00021. View

12.

Shaffer D, Fisher P, Cohen P, Piacentini J, Davies M, Conners C . The Diagnostic Interview Schedule for Children-Revised Version (DISC-R): I. Preparation, field testing, interrater reliability, and acceptability. J Am Acad Child Adolesc Psychiatry. 1993; 32(3):643-50. DOI: 10.1097/00004583-199305000-00023. View

13.

Jensen P, Salzberg A, Richters J, Watanabe H . Scales, diagnoses, and child psychopathology: I. CBCL and DISC relationships. J Am Acad Child Adolesc Psychiatry. 1993; 32(2):397-406. DOI: 10.1097/00004583-199303000-00022. View

14.

Reich W, Cottler L, McCallum K, Corwin D, VanEerdewegh M . Computerized interviews as a method of assessing psychopathology in children. Compr Psychiatry. 1995; 36(1):40-5. DOI: 10.1016/0010-440x(95)90097-f. View

15.

Lahey B, Applegate B, McBurnett K, Biederman J, Greenhill L, Hynd G . DSM-IV field trials for attention deficit hyperactivity disorder in children and adolescents. Am J Psychiatry. 1994; 151(11):1673-85. DOI: 10.1176/ajp.151.11.1673. View

16.

Lucas C, Fisher P, Piacentini J, Zhang H, Jensen P, Shaffer D . Features of interviews questions associated with attenuation of symptom reports. J Abnorm Child Psychol. 2000; 27(6):429-37. DOI: 10.1023/a:1021975824957. View

17.

Shaffer D, Dulcan M, Jensen P, Fisher P, BIRD H, Goodman S . Criterion validity of the NIMH Diagnostic Interview Schedule for Children Version 2.3 (DISC-2.3). J Am Acad Child Adolesc Psychiatry. 1996; 35(7):878-88. DOI: 10.1097/00004583-199607000-00013. View

18.

Angold A, Costello E . A test-retest reliability study of child-reported psychiatric symptoms and diagnoses using the Child and Adolescent Psychiatric Assessment (CAPA-C). Psychol Med. 1995; 25(4):755-62. DOI: 10.1017/s0033291700034991. View

19.

Jensen P, Roper M, Fisher P, Piacentini J, Canino G, Richters J . Test-retest reliability of the Diagnostic Interview Schedule for Children (DISC 2.1). Parent, child, and combined algorithms. Arch Gen Psychiatry. 1995; 52(1):61-71. DOI: 10.1001/archpsyc.1995.03950130061007. View

20.

Jensen P, Watanabe H, Richters J, Roper M, Hibbs E, Salzberg A . Scales, diagnoses, and child psychopathology: II. Comparing the CBCL and the DISC against external validators. J Abnorm Child Psychol. 1996; 24(2):151-68. DOI: 10.1007/BF01441482. View