» Articles » PMID: 30638310

How Effective is LENA in Detecting Speech Vocalizations and Language Produced by Children and Adolescents with ASD in Different Contexts?

Abstract

The LENA system was designed and validated to provide information about the language environment in children 0 to 4 years of age and its use has been expanded to populations with a number of communication profiles. Its utility in children 5 years of age and older is not yet known. The present study used acoustic data from two samples of children with autism spectrum disorders (ASD) to evaluate the reliability of LENA automated analyses for detecting speech utterances in older, school age children, and adolescents with ASD, in clinic and home environments. Participants between 5 and 18 years old who were minimally verbal (study 1) or had a range of verbal abilities (study 2) completed standardized assessments in the clinic (study 1 and 2) and in the home (study 2) while speech was recorded from a LENA device. We compared LENA segment labels with manual ground truth coding by human transcribers using two different methods. We found that the automated LENA algorithms were not successful (<50% reliable) in detecting vocalizations from older children and adolescents with ASD, and that the proportion of speaker misclassifications by the automated system increased significantly with the target-child's age. The findings in children and adolescents with ASD suggest possibly misleading results when expanding the use of LENA beyond the age ranges for which it was developed and highlight the need to develop novel automated methods that are more appropriate for older children. Autism Research 2019, 12: 628-635. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: Current commercially available speech detection algorithms (LENA system) were previously validated in toddlers and children up to 48 months of age, and it is not known whether they are reliable in older children and adolescents. Our data suggest that LENA does not adequately capture speech in school age children and adolescents with autism and highlights the need to develop new automated methods for older children.

Citing Articles

Validation of the Language ENvironment Analysis (LENA) Automated Speech Processing Algorithm Labels for Adult and Child Segments in a Sample of Families From India.

Meera S, Swaminathan D, Venkata Murali S, Raju R, Srikar M, Shyam Sundar S J Speech Lang Hear Res. 2024; 68(1):40-53.

PMID: 39641581 PMC: 11842061. DOI: 10.1044/2024_JSLHR-24-00099.


Adaptive thresholding increases sensitivity to detect changes in the rate of skin conductance responses to psychologically arousing stimuli in both laboratory and ambulatory settings.

Kleckner I, Wormwood J, Jones R, Culakova E, Barrett L, Lord C Int J Psychophysiol. 2023; 196:112280.

PMID: 38104772 PMC: 10872538. DOI: 10.1016/j.ijpsycho.2023.112280.


The Stability and Validity of Automated Indices of Vocal Development in Infants With Autistic and Non-Autistic Siblings.

Markfeld J, Feldman J, Daly C, Santapuram P, Bowman S, Dunham-Carr K J Speech Lang Hear Res. 2023; 66(12):4934-4948.

PMID: 37889262 PMC: 11001377. DOI: 10.1044/2023_JSLHR-23-00069.


Say that again: Quantifying patterns of production for children with autism using recurrence analysis.

Mankovich A, Blume J, Wittke K, Mastergeorge A, Paxton A, Naigles L Front Psychol. 2022; 13:999396.

PMID: 36337522 PMC: 9635266. DOI: 10.3389/fpsyg.2022.999396.


Conversation Initiation of Mothers, Fathers, and Toddlers in their Natural Home Environment.

VanDam M, Thompson L, Wilson-Fowler E, Campanella S, Wolfenstein K, De Palma P Comput Speech Lang. 2021; 73.

PMID: 34970021 PMC: 8713565. DOI: 10.1016/j.csl.2021.101338.


References
1.
Berry-Kravis E, Hessl D, Rathmell B, Zarevics P, Cherubini M, Walton-Bowen K . Effects of STX209 (arbaclofen) on neurobehavioral function in children and adults with fragile X syndrome: a randomized, controlled, phase 2 trial. Sci Transl Med. 2012; 4(152):152ra127. DOI: 10.1126/scitranslmed.3004214. View

2.
Zimmerman F, Gilkerson J, Richards J, Christakis D, Xu D, Gray S . Teaching by listening: the importance of adult-child conversations to language development. Pediatrics. 2009; 124(1):342-9. DOI: 10.1542/peds.2008-2267. View

3.
Yoder P, Oller D, Richards J, Gray S, Gilkerson J . Stability and validity of an automated measure of vocal development from day-long samples in children with and without autism spectrum disorder. Autism Res. 2013; 6(2):103-7. PMC: 3664259. DOI: 10.1002/aur.1271. View

4.
Gilkerson J, Richards J, Warren S, Montgomery J, Greenwood C, Oller D . Mapping the Early Language Environment Using All-Day Recordings and Automated Analysis. Am J Speech Lang Pathol. 2017; 26(2):248-265. PMC: 6195063. DOI: 10.1044/2016_AJSLP-15-0169. View

5.
Oller D, Niyogi P, Gray S, Richards J, Gilkerson J, Xu D . Automated vocal analysis of naturalistic recordings from children with autism, language delay, and typical development. Proc Natl Acad Sci U S A. 2010; 107(30):13354-9. PMC: 2922144. DOI: 10.1073/pnas.1003882107. View