How (and Why) Does Iconicity Effect Lexical Access: An Electrophysiological Study of American Sign Language

Overview

Journal Neuropsychologia

Specialties Neurology
Psychology

Date 2023 Feb 16

PMID 36796720

Authors

Meghan E McGarry

Katherine J Midgley

Phillip J Holcomb

Karen Emmorey

Affiliations

Soon will be listed here.

Abstract

Prior research has found that iconicity facilitates sign production in picture-naming paradigms and has effects on ERP components. These findings may be explained by two separate hypotheses: (1) a task-specific hypothesis that suggests these effects occur because visual features of the iconic sign form can map onto the visual features of the pictures, and (2) a semantic feature hypothesis that suggests that the retrieval of iconic signs results in greater semantic activation due to the robust representation of sensory-motor semantic features compared to non-iconic signs. To test these two hypotheses, iconic and non-iconic American Sign Language (ASL) signs were elicited from deaf native/early signers using a picture-naming task and an English-to-ASL translation task, while electrophysiological recordings were made. Behavioral facilitation (faster response times) and reduced negativities were observed for iconic signs (both prior to and within the N400 time window), but only in the picture-naming task. No ERP or behavioral differences were found between iconic and non-iconic signs in the translation task. This pattern of results supports the task-specific hypothesis and provides evidence that iconicity only facilitates sign production when the eliciting stimulus and the form of the sign can visually overlap (a picture-sign alignment effect).

Citing Articles

Neural effects differ for learning highly iconic versus non-iconic signs in hearing adults.

Akers E, Midgley K, Holcomb P, Meade G, Emmorey K Biling (Camb Engl). 2024; 27(4):655-667.

PMID: 39512759 PMC: 11542927. DOI: 10.1017/s1366728923000809.

An ERP investigation of perceptual vs motoric iconicity in sign production.

McGarry M, Midgley K, Holcomb P, Emmorey K Neuropsychologia. 2024; 203:108966.

PMID: 39098388 PMC: 11462866. DOI: 10.1016/j.neuropsychologia.2024.108966.

Sign learning of hearing children in inclusive day care centers-does iconicity matter?.

Goppelt-Kunkel M, Stroh A, Hanel-Faulhaber B Front Psychol. 2023; 14:1196114.

PMID: 37655202 PMC: 10467423. DOI: 10.3389/fpsyg.2023.1196114.

References

Perniss P, Thompson R, Vigliocco G . Iconicity as a general property of language: evidence from spoken and signed languages. Front Psychol. 2011; 1:227. PMC: 3153832. DOI: 10.3389/fpsyg.2010.00227. View

McGarry M, Massa N, Mott M, Midgley K, Holcomb P, Emmorey K . Matching pictures and signs: An ERP study of the effects of iconic structural alignment in American sign language. Neuropsychologia. 2021; 162:108051. PMC: 8560580. DOI: 10.1016/j.neuropsychologia.2021.108051. View

McPherson W, Holcomb P . An electrophysiological investigation of semantic priming with pictures of real objects. Psychophysiology. 1999; 36(1):53-65. DOI: 10.1017/s0048577299971196. View

Assaneo M, Nichols J, Trevisan M . The anatomy of onomatopoeia. PLoS One. 2011; 6(12):e28317. PMC: 3237459. DOI: 10.1371/journal.pone.0028317. View

Kutas M, Federmeier K . Thirty years and counting: finding meaning in the N400 component of the event-related brain potential (ERP). Annu Rev Psychol. 2010; 62:621-47. PMC: 4052444. DOI: 10.1146/annurev.psych.093008.131123. View

Ortega G, Ostarek M . Evidence for visual simulation during sign language processing. J Exp Psychol Gen. 2021; 150(10):2158-2166. DOI: 10.1037/xge0001041. View

Ostarek M, Huettig F . Spoken words can make the invisible visible-Testing the involvement of low-level visual representations in spoken word processing. J Exp Psychol Hum Percept Perform. 2017; 43(3):499-508. DOI: 10.1037/xhp0000313. View

Imai M, Miyazaki M, Yeung H, Hidaka S, Kantartzis K, Okada H . Sound symbolism facilitates word learning in 14-month-olds. PLoS One. 2015; 10(2):e0116494. PMC: 4335030. DOI: 10.1371/journal.pone.0116494. View

Caselli N, Pyers J . Degree and not type of iconicity affects sign language vocabulary acquisition. J Exp Psychol Learn Mem Cogn. 2019; 46(1):127-139. PMC: 6858483. DOI: 10.1037/xlm0000713. View

10.

Barber H, Otten L, Kousta S, Vigliocco G . Concreteness in word processing: ERP and behavioral effects in a lexical decision task. Brain Lang. 2013; 125(1):47-53. DOI: 10.1016/j.bandl.2013.01.005. View

11.

Ortega G, Sumer B, Ozyurek A . Type of iconicity matters in the vocabulary development of signing children. Dev Psychol. 2016; 53(1):89-99. DOI: 10.1037/dev0000161. View

12.

van Elk M, van Schie H, Bekkering H . The N400-concreteness effect reflects the retrieval of semantic information during the preparation of meaningful actions. Biol Psychol. 2010; 85(1):134-42. DOI: 10.1016/j.biopsycho.2010.06.004. View

13.

Thompson R, Vinson D, Vigliocco G . The link between form and meaning in American Sign Language: lexical processing effects. J Exp Psychol Learn Mem Cogn. 2009; 35(2):550-7. PMC: 3667647. DOI: 10.1037/a0014547. View

14.

Perry L, Perlman M, Lupyan G . Iconicity in English and Spanish and Its Relation to Lexical Category and Age of Acquisition. PLoS One. 2015; 10(9):e0137147. PMC: 4560417. DOI: 10.1371/journal.pone.0137147. View

15.

Trettenbrein P, Pendzich N, Cramer J, Steinbach M, Zaccarella E . Psycholinguistic norms for more than 300 lexical signs in German Sign Language (DGS). Behav Res Methods. 2021; 53(5):1817-1832. PMC: 8516755. DOI: 10.3758/s13428-020-01524-y. View

16.

Caselli N, Sehyr Z, Cohen-Goldberg A, Emmorey K . ASL-LEX: A lexical database of American Sign Language. Behav Res Methods. 2016; 49(2):784-801. PMC: 5116008. DOI: 10.3758/s13428-016-0742-0. View

17.

Schendan H, Kutas M . Neurophysiological evidence for two processing times for visual object identification. Neuropsychologia. 2002; 40(7):931-45. DOI: 10.1016/s0028-3932(01)00176-2. View

18.

Holcomb P, Kounios J, Anderson J, West W . Dual-coding, context-availability, and concreteness effects in sentence comprehension: an electrophysiological investigation. J Exp Psychol Learn Mem Cogn. 1999; 25(3):721-42. DOI: 10.1037//0278-7393.25.3.721. View

19.

Bosworth R, Emmorey K . Effects of iconicity and semantic relatedness on lexical access in american sign language. J Exp Psychol Learn Mem Cogn. 2010; 36(6):1573-81. PMC: 2970771. DOI: 10.1037/a0020934. View

20.

Kravitz D, Saleem K, Baker C, Mishkin M . A new neural framework for visuospatial processing. Nat Rev Neurosci. 2011; 12(4):217-30. PMC: 3388718. DOI: 10.1038/nrn3008. View