Computer Vision Analysis of Caregiver-Child Interactions in Children with Neurodevelopmental Disorders: A Preliminary Report

Overview

Journal J Autism Dev Disord

Publisher Springer

Date 2023 Apr 27

PMID 37103659

Authors

Dmitry Yu Isaev

Maura Sabatos-DeVito

J Matias Di Martino

Kimberly Carpenter

Rachel Aiello

Scott Compton

Naomi Davis

Lauren Franz

Connor Sullivan

Geraldine Dawson

Guillermo Sapiro

Affiliations

Soon will be listed here.

Abstract

We report preliminary results of computer vision analysis of caregiver-child interactions during free play with children diagnosed with autism (N = 29, 41-91 months), attention-deficit/hyperactivity disorder (ADHD, N = 22, 48-100 months), or combined autism + ADHD (N = 20, 56-98 months), and neurotypical children (NT, N = 7, 55-95 months). We conducted micro-analytic analysis of 'reaching to a toy,' as a proxy for initiating or responding to a toy play bout. Dyadic analysis revealed two clusters of interaction patterns, which differed in frequency of 'reaching to a toy' and caregivers' contingent responding to the child's reach for a toy by also reaching for a toy. Children in dyads with higher caregiver responsiveness had less developed language, communication, and socialization skills. Clusters were not associated with diagnostic groups. These results hold promise for automated methods of characterizing caregiver responsiveness in dyadic interactions for assessment and outcome monitoring in clinical trials.

Citing Articles

Artificial intelligence-powered 3D analysis of video-based caregiver-child interactions.

Weng Z, Bravo-Sanchez L, Wang Z, Howard C, Xenochristou M, Meister N Sci Adv. 2025; 11(7):eadp4422.

PMID: 39951536 PMC: 11837989. DOI: 10.1126/sciadv.adp4422.

References

Adamson L, Bakeman R, Suma K, Robins D . An Expanded View of Joint Attention: Skill, Engagement, and Language in Typical Development and Autism. Child Dev. 2017; 90(1):e1-e18. PMC: 5891390. DOI: 10.1111/cdev.12973. View

Adamson L, Bakeman R, Suma K, Robins D . Autism Adversely Affects Auditory Joint Engagement During Parent-toddler Interactions. Autism Res. 2020; 14(2):301-314. PMC: 7878296. DOI: 10.1002/aur.2355. View

Bornstein M, Tamis-LeMonda C, Hahn C, Haynes O . Maternal responsiveness to young children at three ages: longitudinal analysis of a multidimensional, modular, and specific parenting construct. Dev Psychol. 2008; 44(3):867-74. DOI: 10.1037/0012-1649.44.3.867. View

Campbell K, Carpenter K, Hashemi J, Espinosa S, Marsan S, Borg J . Computer vision analysis captures atypical attention in toddlers with autism. Autism. 2018; 23(3):619-628. PMC: 6119515. DOI: 10.1177/1362361318766247. View

Cao Z, Hidalgo G, Simon T, Wei S, Sheikh Y . OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields. IEEE Trans Pattern Anal Mach Intell. 2019; 43(1):172-186. DOI: 10.1109/TPAMI.2019.2929257. View

Carpenter K, Hahemi J, Campbell K, Lippmann S, Baker J, Egger H . Digital Behavioral Phenotyping Detects Atypical Pattern of Facial Expression in Toddlers with Autism. Autism Res. 2020; 14(3):488-499. PMC: 7920907. DOI: 10.1002/aur.2391. View

Chen M, Chow S, Hammal Z, Messinger D, Cohn J . A Person- and Time-Varying Vector Autoregressive Model to Capture Interactive Infant-Mother Head Movement Dynamics. Multivariate Behav Res. 2020; 56(5):739-767. PMC: 8763288. DOI: 10.1080/00273171.2020.1762065. View

Davis P, Elsayed H, Crais E, Watson L, Grzadzinski R . Caregiver responsiveness as a mechanism to improve social communication in toddlers: Secondary analysis of a randomized controlled trial. Autism Res. 2021; 15(2):366-378. PMC: 8821206. DOI: 10.1002/aur.2640. View

Dawson G, Campbell K, Hashemi J, Lippmann S, Smith V, Carpenter K . Atypical postural control can be detected via computer vision analysis in toddlers with autism spectrum disorder. Sci Rep. 2018; 8(1):17008. PMC: 6242931. DOI: 10.1038/s41598-018-35215-8. View

10.

Egger H, Dawson G, Hashemi J, Carpenter K, Espinosa S, Campbell K . Automatic emotion and attention analysis of young children at home: a ResearchKit autism feasibility study. NPJ Digit Med. 2019; 1:20. PMC: 6550157. DOI: 10.1038/s41746-018-0024-6. View

11.

Fuchs P, Nussbeck F, Meuwly N, Bodenmann G . Analyzing Dyadic Sequence Data-Research Questions and Implied Statistical Models. Front Psychol. 2017; 8:429. PMC: 5387096. DOI: 10.3389/fpsyg.2017.00429. View

12.

Lord C, Risi S, Lambrecht L, Cook Jr E, Leventhal B, DiLavore P . The autism diagnostic observation schedule-generic: a standard measure of social and communication deficits associated with the spectrum of autism. J Autism Dev Disord. 2000; 30(3):205-23. View

13.

Nevill R, Lecavalier L, Stratis E . Meta-analysis of parent-mediated interventions for young children with autism spectrum disorder. Autism. 2018; 22(2):84-98. DOI: 10.1177/1362361316677838. View

14.

Rogers S, Estes A, Lord C, Vismara L, Winter J, Fitzpatrick A . Effects of a brief Early Start Denver model (ESDM)-based parent intervention on toddlers at risk for autism spectrum disorders: a randomized controlled trial. J Am Acad Child Adolesc Psychiatry. 2012; 51(10):1052-65. PMC: 3487718. DOI: 10.1016/j.jaac.2012.08.003. View

15.

Siller M, Sigman M . The behaviors of parents of children with autism predict the subsequent development of their children's communication. J Autism Dev Disord. 2002; 32(2):77-89. DOI: 10.1023/a:1014884404276. View

16.

Siller M, Sigman M . Modeling longitudinal change in the language abilities of children with autism: parent behaviors and child characteristics as predictors of change. Dev Psychol. 2008; 44(6):1691-704. DOI: 10.1037/a0013771. View

17.

Suarez-Rivera C, Smith L, Yu C . Multimodal parent behaviors within joint attention support sustained attention in infants. Dev Psychol. 2018; 55(1):96-109. PMC: 6296904. DOI: 10.1037/dev0000628. View

18.

Tallmadge J, Barkley R . The interactions of hyperactive and normal boys with their fathers and mothers. J Abnorm Child Psychol. 1983; 11(4):565-79. DOI: 10.1007/BF00917085. View

19.

Tomasello M, Farrar M . Joint attention and early language. Child Dev. 1986; 57(6):1454-63. View

20.

Tuncgenc B, Pacheco C, Rochowiak R, Nicholas R, Rengarajan S, Zou E . Computerized Assessment of Motor Imitation as a Scalable Method for Distinguishing Children With Autism. Biol Psychiatry Cogn Neurosci Neuroimaging. 2020; 6(3):321-328. PMC: 7943651. DOI: 10.1016/j.bpsc.2020.09.001. View