The Role of Audiovisual Speech in Fast-Mapping and Novel Word Retention in Monolingual and Bilingual 24-Month-Olds

Overview

Journal Brain Sci

Publisher MDPI

Date 2021 Jan 20

PMID 33467100

Citations 8

Authors

Drew Weatherhead

Maria M Arredondo

Loreto Nacar Garcia

Janet F Werker

Affiliations

Soon will be listed here.

Abstract

Three experiments examined the role of audiovisual speech on 24-month-old monolingual and bilinguals' performance in a fast-mapping task. In all three experiments, toddlers were exposed to familiar trials which tested their knowledge of known word-referent pairs, disambiguation trials in which novel word-referent pairs were indirectly learned, and retention trials which probed their recognition of the newly-learned word-referent pairs. In Experiment 1 ( = 48), lip movements were present during familiar and disambiguation trials, but not retention trials. In Experiment 2 ( = 48), lip movements were present during all three trial types. In Experiment 3 (bilinguals only, = 24), a still face with no lip movements was present in all three trial types. While toddlers succeeded in the familiar and disambiguation trials of every experiment, success in the retention trials was only found in Experiment 2. This work suggests that the extra-linguistic support provided by lip movements improved the learning and recognition of the novel words.

Citing Articles

When Language Background Does Not Matter: Both Mono- and Bilingual Children Use Mutual Exclusivity and Pragmatic Context to Learn Novel Words.

Bleijlevens N, Ciesla A, Behne T Dev Sci. 2025; 28(3):e13618.

PMID: 40066844 PMC: 11894922. DOI: 10.1111/desc.13618.

Monolingual and bilingual infants' attention to talking faces: evidence from eye-tracking and Bayesian modeling.

Lemonnier S, Fayolle B, Sebastian-Galles N, Bremond R, Diard J, Fort M Front Psychol. 2024; 15:1373191.

PMID: 38550642 PMC: 10973108. DOI: 10.3389/fpsyg.2024.1373191.

The Role of Talking Faces in Infant Language Learning: Mind the Gap between Screen-Based Settings and Real-Life Communicative Interactions.

Birules J, Goupil L, Josse J, Fort M Brain Sci. 2023; 13(8).

PMID: 37626523 PMC: 10452843. DOI: 10.3390/brainsci13081167.

Long-term phonemic representations become audiovisual by mid-childhood.

Kaganovich N, Schumaker J, Christ S Neuropsychologia. 2023; 188:108633.

PMID: 37394134 PMC: 10530328. DOI: 10.1016/j.neuropsychologia.2023.108633.

Touch to learn: Multisensory input supports word learning and processing.

Seidl A, Indarjit M, Borovsky A Dev Sci. 2023; 27(1):e13419.

PMID: 37291692 PMC: 10704002. DOI: 10.1111/desc.13419.

References

McMurray B, Horst J, Samuelson L . Word learning emerges from the interaction of online referent selection and slow associative learning. Psychol Rev. 2012; 119(4):831-77. PMC: 3632668. DOI: 10.1037/a0029872. View

Kalashnikova M, Escudero P, Kidd E . The development of fast-mapping and novel word retention strategies in monolingual and bilingual infants. Dev Sci. 2018; 21(6):e12674. DOI: 10.1111/desc.12674. View

Markman E, Wachtel G . Children's use of mutual exclusivity to constrain the meanings of words. Cogn Psychol. 1988; 20(2):121-57. DOI: 10.1016/0010-0285(88)90017-5. View

May L, Gervain J, Carreiras M, Werker J . The specificity of the neural response to speech at birth. Dev Sci. 2017; 21(3):e12564. DOI: 10.1111/desc.12564. View

Lewkowicz D, Hansen-Tift A . Infants deploy selective attention to the mouth of a talking face when learning speech. Proc Natl Acad Sci U S A. 2012; 109(5):1431-6. PMC: 3277111. DOI: 10.1073/pnas.1114783109. View

Hunnius S, Geuze R . Developmental Changes in Visual Scanning of Dynamic Faces and Abstract Stimuli in Infants: A Longitudinal Study. Infancy. 2021; 6(2):231-255. DOI: 10.1207/s15327078in0602_5. View

Houston-Price C, Plunkett K, Harris P . 'Word-learning wizardry' at 1;6. J Child Lang. 2005; 32(1):175-89. DOI: 10.1017/s0305000904006610. View

Ayneto A, Sebastian-Galles N . The influence of bilingualism on the preference for the mouth region of dynamic faces. Dev Sci. 2016; 20(1). DOI: 10.1111/desc.12446. View

Weisleder A, Fernald A . Talking to children matters: early language experience strengthens processing and builds vocabulary. Psychol Sci. 2013; 24(11):2143-52. PMC: 5510534. DOI: 10.1177/0956797613488145. View

10.

Weatherhead D, White K . Read my lips: Visual speech influences word processing in infants. Cognition. 2017; 160:103-109. DOI: 10.1016/j.cognition.2017.01.002. View

11.

Kan P, Kohnert K . Fast mapping by bilingual preschool children. J Child Lang. 2008; 35(3):495-514. DOI: 10.1017/S0305000907008604. View

12.

Barenholtz E, Mavica L, Lewkowicz D . Language familiarity modulates relative attention to the eyes and mouth of a talker. Cognition. 2015; 147:100-5. PMC: 6367725. DOI: 10.1016/j.cognition.2015.11.013. View

13.

Byers-Heinlein K, Werker J . Lexicon structure and the disambiguation of novel words: evidence from bilingual infants. Cognition. 2013; 128(3):407-16. DOI: 10.1016/j.cognition.2013.05.010. View

14.

Havy M, Foroud A, Fais L, Werker J . The Role of Auditory and Visual Speech in Word Learning at 18 Months and in Adulthood. Child Dev. 2017; 88(6):2043-2059. PMC: 6540983. DOI: 10.1111/cdev.12715. View

15.

Weikum W, Vouloumanos A, Navarra J, Soto-Faraco S, Sebastian-Galles N, Werker J . Visual language discrimination in infancy. Science. 2007; 316(5828):1159. DOI: 10.1126/science.1137686. View

16.

Bion R, Borovsky A, Fernald A . Fast mapping, slow learning: disambiguation of novel word-object mappings in relation to vocabulary learning at 18, 24, and 30months. Cognition. 2012; 126(1):39-53. PMC: 6590692. DOI: 10.1016/j.cognition.2012.08.008. View

17.

Morin-Lessard E, Poulin-Dubois D, Segalowitz N, Byers-Heinlein K . Selective attention to the mouth of talking faces in monolinguals and bilinguals aged 5 months to 5 years. Dev Psychol. 2019; 55(8):1640-1655. DOI: 10.1037/dev0000750. View

18.

Horst J, Samuelson L . Fast Mapping but Poor Retention by 24-Month-Old Infants. Infancy. 2021; 13(2):128-157. DOI: 10.1080/15250000701795598. View

19.

Bialystok E, Barac R, Blaye A, Poulin-Dubois D . Word Mapping and Executive Functioning in Young Monolingual and Bilingual Children. J Cogn Dev. 2011; 11(4):485-508. PMC: 3010730. DOI: 10.1080/15248372.2010.516420. View

20.

Halberda J . The development of a word-learning strategy. Cognition. 2002; 87(1):B23-34. DOI: 10.1016/s0010-0277(02)00186-5. View