Assessing Social Communication and Collaboration in Autism Spectrum Disorder Using Intelligent Collaborative Virtual Environments

Overview

Journal J Autism Dev Disord

Publisher Springer

Date 2019 Oct 5

PMID 31583625

Citations 6

Authors

Lian Zhang

Amy S Weitlauf

Ashwaq Zaini Amat

Amy Swanson

Zachary E Warren

Nilanjan Sarkar

Affiliations

Soon will be listed here.

Abstract

Existing literature regarding social communication outcomes of interventions in autism spectrum disorder (ASD) depends upon human raters, with limited generalizability to real world settings. Technological innovation, particularly virtual reality (VR) and collaborative virtual environments (CVE), could offer a replicable, low cost measurement platform when endowed with intelligent agent technology and peer-based interactions. We developed and piloted a novel collaborative virtual environment and intelligent agent (CRETA) for the assessment of social communication and collaboration within system and peer interactions. The system classified user statements with moderate to high accuracies. We found moderate to high agreement in displayed communication and collaboration skills between human-human and human-agent interactions. CRETA offers a promising avenue for future development of autonomous measurement systems for ASD research.

Citing Articles

Examining Virtual Reality Interventions for Social Skills in Children with Autism Spectrum Disorder: A Systematic Review.

Altin Y, Bosnak O, Turhan C J Autism Dev Disord. 2025; .

PMID: 39907930 DOI: 10.1007/s10803-025-06741-y.

Virtual environments as a novel and promising approach in (neuro)diagnosis and (neuro)therapy: a perspective on the example of autism spectrum disorder.

Sokolowska E, Sokolowska B, Chrapusta S, Sulejczak D Front Neurosci. 2025; 18:1461142.

PMID: 39886337 PMC: 11780595. DOI: 10.3389/fnins.2024.1461142.

Using iVR to deliver optimal psychotherapy experience-current perspectives on VRET for acrophobia.

Kvapil Varsova K, Jurik V Front Psychol. 2024; 15:1491622.

PMID: 39703878 PMC: 11656311. DOI: 10.3389/fpsyg.2024.1491622.

The Application of Extended Reality in Treating Children with Autism Spectrum Disorder.

Zhao W, Xu S, Zhang Y, Li D, Zhu C, Wang K Neurosci Bull. 2024; 40(8):1189-1204.

PMID: 38498091 PMC: 11306495. DOI: 10.1007/s12264-024-01190-6.

Global trends and hotspots in the digital therapeutics of autism spectrum disorders: a bibliometric analysis from 2002 to 2022.

Wu X, Deng H, Jian S, Chen H, Li Q, Gong R Front Psychiatry. 2023; 14:1126404.

PMID: 37255688 PMC: 10225518. DOI: 10.3389/fpsyt.2023.1126404.

References

Kandalaft M, Didehbani N, Krawczyk D, Allen T, Chapman S . Virtual reality social cognition training for young adults with high-functioning autism. J Autism Dev Disord. 2012; 43(1):34-44. PMC: 3536992. DOI: 10.1007/s10803-012-1544-6. View

Samad M, Diawara N, Bobzien J, Harrington J, Witherow M, Iftekharuddin K . A Feasibility Study of Autism Behavioral Markers in Spontaneous Facial, Visual, and Hand Movement Response Data. IEEE Trans Neural Syst Rehabil Eng. 2018; 26(2):353-361. DOI: 10.1109/TNSRE.2017.2768482. View

Lord C, Risi S, Lambrecht L, Cook Jr E, Leventhal B, DiLavore P . The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord. 2000; 30(3):205-23. View

Leman P . How do groups work? Age differences in performance and the social outcomes of peer collaboration. Cogn Sci. 2014; 39(4):804-20. DOI: 10.1111/cogs.12172. View

Connor A, Sung C, Strain A, Zeng S, Fabrizi S . Building Skills, Confidence, and Wellness: Psychosocial Effects of Soft Skills Training for Young Adults with Autism. J Autism Dev Disord. 2019; 50(6):2064-2076. DOI: 10.1007/s10803-019-03962-w. View

Parsons S, Mitchell P . The potential of virtual reality in social skills training for people with autistic spectrum disorders. J Intellect Disabil Res. 2002; 46(Pt 5):430-43. DOI: 10.1046/j.1365-2788.2002.00425.x. View

Bennett A, Miller J, Stollon N, Prasad R, Blum N . Autism Spectrum Disorder and Transition-Aged Youth. Curr Psychiatry Rep. 2018; 20(11):103. DOI: 10.1007/s11920-018-0967-y. View

Parsons L, Cordier R, Munro N, Joosten A, Speyer R . A systematic review of pragmatic language interventions for children with autism spectrum disorder. PLoS One. 2017; 12(4):e0172242. PMC: 5398499. DOI: 10.1371/journal.pone.0172242. View

Parsons L, Cordier R, Munro N, Joosten A . The feasibility and appropriateness of a peer-to-peer, play-based intervention for improving pragmatic language in children with autism spectrum disorder. Int J Speech Lang Pathol. 2018; 21(4):412-424. DOI: 10.1080/17549507.2018.1492630. View

10.

Scahill L, Aman M, Lecavalier L, Halladay A, Bishop S, Bodfish J . Measuring repetitive behaviors as a treatment endpoint in youth with autism spectrum disorder. Autism. 2013; 19(1):38-52. DOI: 10.1177/1362361313510069. View

11.

Bauminger-Zviely N, Eden S, Zancanaro M, Weiss P, Gal E . Increasing social engagement in children with high-functioning autism spectrum disorder using collaborative technologies in the school environment. Autism. 2013; 17(3):317-39. DOI: 10.1177/1362361312472989. View

12.

Vernon T, Miller A, Ko J, Barrett A, McGarry E . A Randomized Controlled Trial of the Social Tools And Rules for Teens (START) Program: An Immersive Socialization Intervention for Adolescents with Autism Spectrum Disorder. J Autism Dev Disord. 2017; 48(3):892-904. DOI: 10.1007/s10803-017-3380-1. View

13.

Bekele E, Zheng Z, Swanson A, Crittendon J, Warren Z, Sarkar N . Understanding how adolescents with autism respond to facial expressions in virtual reality environments. IEEE Trans Vis Comput Graph. 2013; 19(4):711-20. PMC: 3867269. DOI: 10.1109/TVCG.2013.42. View

14.

Laugeson E, Ellingsen R, Sanderson J, Tucci L, Bates S . The ABC's of teaching social skills to adolescents with autism spectrum disorder in the classroom: the UCLA PEERS (®) Program. J Autism Dev Disord. 2014; 44(9):2244-56. DOI: 10.1007/s10803-014-2108-8. View

15.

Kaur M, Srinivasan S, Bhat A . Comparing motor performance, praxis, coordination, and interpersonal synchrony between children with and without Autism Spectrum Disorder (ASD). Res Dev Disabil. 2017; 72:79-95. PMC: 5743591. DOI: 10.1016/j.ridd.2017.10.025. View

16.

Lahiri U, Bekele E, Dohrmann E, Warren Z, Sarkar N . Design of a virtual reality based adaptive response technology for children with autism. IEEE Trans Neural Syst Rehabil Eng. 2012; 21(1):55-64. PMC: 3867261. DOI: 10.1109/TNSRE.2012.2218618. View

17.

McPheeters M, Warren Z, Sathe N, Bruzek J, Krishnaswami S, Jerome R . A systematic review of medical treatments for children with autism spectrum disorders. Pediatrics. 2011; 127(5):e1312-21. DOI: 10.1542/peds.2011-0427. View

18.

Dowd A, McGinley J, Taffe J, Rinehart N . Do planning and visual integration difficulties underpin motor dysfunction in autism? A kinematic study of young children with autism. J Autism Dev Disord. 2011; 42(8):1539-48. DOI: 10.1007/s10803-011-1385-8. View

19.

Mitchell P, Parsons S, Leonard A . Using virtual environments for teaching social understanding to 6 adolescents with autistic spectrum disorders. J Autism Dev Disord. 2006; 37(3):589-600. DOI: 10.1007/s10803-006-0189-8. View

20.

Veenstra-VanderWeele J, Warren Z . Intervention in the context of development: pathways toward new treatments. Neuropsychopharmacology. 2014; 40(1):225-37. PMC: 4262912. DOI: 10.1038/npp.2014.232. View