A Generalizability Theory Analysis of Group Process Ratings in the Treatment of Cocaine Dependence

Overview

Journal Psychother Res

Publisher Routledge

Specialties Pharmacology
Psychiatry
Psychology

Date 2011 Mar 17

PMID 21409739

Citations 13

Authors

Paul Crits-Christoph

Jennifer Johnson

Robert Gallop

Mary Beth Connolly Gibbons

Sarah Ring-Kurtz

Jessica L Hamilton

Xin Tu

Affiliations

Soon will be listed here.

Abstract

Videotaped group drug counseling sessions were rated for alliance, self-disclosure, positive and negative feedback, group cohesion, and degree of participation of each group member. Interrater reliability was good to excellent for most measures. However, generalizability coefficients based on statistical models that included terms for patient, counselor, session, group, and rater revealed that some measures had inadequate dependability at the patient level if only two raters and two sessions were used to create patient-level scores. In contrast, good generalizability coefficients based on two raters and two sessions were obtained for alliance, non-positive learning statements received from counselor, participation variables, and self-disclosures about the past. The implications of the findings for the design of process-outcome studies are discussed.

Citing Articles

Development and preliminary validation of the chronic obstructive pulmonary disease scale quality of life instruments for chronic diseases-chronic obstructive pulmonary disease based on classical test theory and generalizability theory.

Wan C, Yang Z, Zhao Z, Quan P, Wu B, Yang Y Chron Respir Dis. 2022; 19:14799731221104099.

PMID: 36000309 PMC: 9421010. DOI: 10.1177/14799731221104099.

Development and validation of the peptic ulcer scale under the system of quality of life instruments for chronic diseases based on classical test theory and generalizability theory.

Wan C, Chen Y, Gao L, Zhang Q, Quan P, Sun X BMC Gastroenterol. 2020; 20(1):422.

PMID: 33317456 PMC: 7734778. DOI: 10.1186/s12876-020-01562-y.

The reproducibility of psychiatric evaluations of work disability: two reliability and agreement studies.

Kunz R, von Allmen D, Marelli R, Hoffmann-Richter U, Jeger J, Mager R BMC Psychiatry. 2019; 19(1):205.

PMID: 31266488 PMC: 6607597. DOI: 10.1186/s12888-019-2171-y.

Reliability analysis of the Chinese version of the Functional Assessment of Cancer Therapy - Leukemia (FACT-Leu) scale based on multivariate generalizability theory.

Meng Q, Yang Z, Wu Y, Xiao Y, Gu X, Zhang M Health Qual Life Outcomes. 2017; 15(1):93.

PMID: 28472955 PMC: 5418704. DOI: 10.1186/s12955-017-0664-2.

Use of a structured functional evaluation process for independent medical evaluations of claimants presenting with disabling mental illness: rationale and design for a multi-center reliability study.

Bachmann M, Boer W, Schandelmaier S, Leibold A, Marelli R, Jeger J BMC Psychiatry. 2016; 16:271.

PMID: 27474008 PMC: 4966817. DOI: 10.1186/s12888-016-0967-6.

References

Tschuschke V, MacKenzie K, Haaser B, Janke G . Self-disclosure, feedback, and outcome in long-term inpatient psychotherapy groups. J Psychother Pract Res. 2012; 5(1):35-44. PMC: 3330407. View

Crits-Christoph P, Siqueland L, Blaine J, Frank A, Luborsky L, Onken L . Psychosocial treatments for cocaine dependence: National Institute on Drug Abuse Collaborative Cocaine Treatment Study. Arch Gen Psychiatry. 1999; 56(6):493-502. DOI: 10.1001/archpsyc.56.6.493. View

Coche E, Dies R, Goettelmann K . Process variables mediating change in intensive group therapy training. Int J Group Psychother. 1991; 41(3):379-97. DOI: 10.1080/00207284.1991.11490664. View

Budman S, Soldz S, Demby A, FELDSTEIN M, Springer T, Davis M . Cohesion, alliance and outcome in group psychotherapy. Psychiatry. 1989; 52(3):339-50. DOI: 10.1080/00332747.1989.11024456. View

Bloch S, Crouch E, Reibstein J . Therapeutic factors in group psychotherapy. A review. Arch Gen Psychiatry. 1981; 38(5):519-26. DOI: 10.1001/archpsyc.1980.01780300031003. View

Connolly Gibbons M, Crits-Christoph P, Levinson J, Gladis M, Siqueland L, Barber J . Therapist interventions in the interpersonal and cognitive therapy sessions of the Treatment of Depression Collaborative Research Program. Am J Psychother. 2002; 56(1):3-26. DOI: 10.1176/appi.psychotherapy.2002.56.1.3. View

Shrout P, Fleiss J . Intraclass correlations: uses in assessing rater reliability. Psychol Bull. 1979; 86(2):420-8. DOI: 10.1037//0033-2909.86.2.420. View

Kipnes D, Piper W, Joyce A . Cohesion and outcome in short-term psychodynamic groups for complicated grief. Int J Group Psychother. 2002; 52(4):483-509. DOI: 10.1521/ijgp.52.4.483.45525. View

Tang T, DeRubeis R . Sudden gains and critical sessions in cognitive-behavioral therapy for depression. J Consult Clin Psychol. 1999; 67(6):894-904. DOI: 10.1037//0022-006x.67.6.894. View

10.

Fenton L, Cecero J, Nich C, Frankforter T, Carroll K . Perspective is everything: the predictive validity of six working alliance instruments. J Psychother Pract Res. 2001; 10(4):262-8. PMC: 3330662. View

11.

Wasserman R, Levy K, Loken E . Generalizability theory in psychotherapy research: the impact of multiple sources of variance on the dependability of psychotherapy process ratings. Psychother Res. 2009; 19(4-5):397-408. DOI: 10.1080/10503300802579156. View

12.

Tschuschke V, Dies R . Intensive analysis of therapeutic factors and outcome in long-term inpatient groups. Int J Group Psychother. 1994; 44(2):185-208. DOI: 10.1080/00207284.1994.11490742. View

13.

Raue P, Goldfried M, Barkham M . The therapeutic alliance in psychodynamic-interpersonal and cognitive-behavioral therapy. J Consult Clin Psychol. 1997; 65(4):582-7. DOI: 10.1037//0022-006x.65.4.582. View

14.

Stiles W, Agnew-Davies R, Barkham M, Culverwell A, Goldfried M, Halstead J . Convergent validity of the Agnew Relationship Measure and the Working Alliance Inventory. Psychol Assess. 2002; 14(2):209-20. DOI: 10.1037//1040-3590.14.2.209. View