Both MOTS-words and POTS-words Prefer Emoji Stimuli over Text Stimuli During a Lexical Judgment Task

Overview

Journal Cereb Cortex

Publisher Oxford University Press

Specialty Neurology

Date 2024 Aug 27

PMID 39191663

Authors

Alexia Dalski

Holly Kular

Julia G Jorgensen

Kalanit Grill-Spector

Mareike Grotheer

Affiliations

Soon will be listed here.

Abstract

The visual word form area in the occipitotemporal sulcus (here OTS-words) is crucial for reading and shows a preference for text stimuli. We hypothesized that this text preference may be driven by lexical processing. Hence, we performed three fMRI experiments (n = 15), systematically varying participants' task and stimulus, and separately evaluated middle mOTS-words and posterior pOTS-words. Experiment 1 contrasted text with other visual stimuli to identify both OTS-words subregions. Experiment 2 utilized an fMRI adaptation paradigm, presenting compound words as texts or emojis. In experiment 3, participants performed a lexical or color judgment task on compound words in text or emoji format. In experiment 2, pOTS-words, but not mOTS-words, showed fMRI adaptation for compound words in both formats. In experiment 3, both subregions showed higher responses to compound words in emoji format. Moreover, mOTS-words showed higher responses during the lexical judgment task and a task-stimulus interaction. Multivariate analyses revealed that distributed responses in pOTS-words encode stimulus and distributed responses in mOTS-words encode stimulus and task. Together, our findings suggest that the function of the OTS-words subregions goes beyond the specific visual processing of text and that these regions are flexibly recruited whenever semantic meaning needs to be assigned to visual input.

References

Grotheer M, Zhen Z, Lerma-Usabiaga G, Grill-Spector K . Separate lanes for adding and reading in the white matter highways of the human brain. Nat Commun. 2019; 10(1):3675. PMC: 6695422. DOI: 10.1038/s41467-019-11424-1. View

Dehaene S, Cohen L, Sigman M, Vinckier F . The neural code for written words: a proposal. Trends Cogn Sci. 2005; 9(7):335-41. DOI: 10.1016/j.tics.2005.05.004. View

Keller A, Jagadeesh A, Bugatus L, Williams L, Grill-Spector K . Attention enhances category representations across the brain with strengthened residual correlations to ventral temporal cortex. Neuroimage. 2022; 249:118900. PMC: 8947761. DOI: 10.1016/j.neuroimage.2022.118900. View

Murtha S, Chertkow H, Beauregard M, Evans A . The neural substrate of picture naming. J Cogn Neurosci. 1999; 11(4):399-423. DOI: 10.1162/089892999563508. View

White A, Palmer J, Boynton G, Yeatman J . Parallel spatial channels converge at a bottleneck in anterior word-selective cortex. Proc Natl Acad Sci U S A. 2019; 116(20):10087-10096. PMC: 6525533. DOI: 10.1073/pnas.1822137116. View

Binder J, Medler D, Desai R, Conant L, Liebenthal E . Some neurophysiological constraints on models of word naming. Neuroimage. 2005; 27(3):677-93. DOI: 10.1016/j.neuroimage.2005.04.029. View

Dehaene-Lambertz G, Monzalvo K, Dehaene S . The emergence of the visual word form: Longitudinal evolution of category-specific ventral visual areas during reading acquisition. PLoS Biol. 2018; 16(3):e2004103. PMC: 5856411. DOI: 10.1371/journal.pbio.2004103. View

Nordt M, Gomez J, Natu V, Rezai A, Finzi D, Kular H . Cortical recycling in high-level visual cortex during childhood development. Nat Hum Behav. 2021; 5(12):1686-1697. PMC: 8678383. DOI: 10.1038/s41562-021-01141-5. View

Yablonski M, Karipidis I, Kubota E, Yeatman J . The transition from vision to language: Distinct patterns of functional connectivity for subregions of the visual word form area. Hum Brain Mapp. 2024; 45(4):e26655. PMC: 10941549. DOI: 10.1002/hbm.26655. View

10.

Rosenke M, van Hoof R, van den Hurk J, Grill-Spector K, Goebel R . A Probabilistic Functional Atlas of Human Occipito-Temporal Visual Cortex. Cereb Cortex. 2020; 31(1):603-619. PMC: 7727347. DOI: 10.1093/cercor/bhaa246. View

11.

Strother L, Zhou Z, Coros A, Vilis T . An fMRI study of visual hemifield integration and cerebral lateralization. Neuropsychologia. 2017; 100:35-43. PMC: 5484576. DOI: 10.1016/j.neuropsychologia.2017.04.003. View

12.

Graves W, Desai R, Humphries C, Seidenberg M, Binder J . Neural systems for reading aloud: a multiparametric approach. Cereb Cortex. 2009; 20(8):1799-815. PMC: 2901017. DOI: 10.1093/cercor/bhp245. View

13.

Ben-Shachar M, Dougherty R, Deutsch G, Wandell B . Differential sensitivity to words and shapes in ventral occipito-temporal cortex. Cereb Cortex. 2006; 17(7):1604-11. DOI: 10.1093/cercor/bhl071. View

14.

Taylor J, Davis M, Rastle K . Mapping visual symbols onto spoken language along the ventral visual stream. Proc Natl Acad Sci U S A. 2019; 116(36):17723-17728. PMC: 6731646. DOI: 10.1073/pnas.1818575116. View

15.

Ardila A, Bertolucci P, Braga L, Castro-Caldas A, Judd T, Kosmidis M . Illiteracy: the neuropsychology of cognition without reading. Arch Clin Neuropsychol. 2010; 25(8):689-712. DOI: 10.1093/arclin/acq079. View

16.

Canario N, Jorge L, Castelo-Branco M . Distinct mechanisms drive hemispheric lateralization of object recognition in the visual word form and fusiform face areas. Brain Lang. 2020; 210:104860. DOI: 10.1016/j.bandl.2020.104860. View

17.

Quinn C, Taylor J, Davis M . Learning and retrieving holistic and componential visual-verbal associations in reading and object naming. Neuropsychologia. 2016; 98:68-84. PMC: 5407349. DOI: 10.1016/j.neuropsychologia.2016.09.025. View

18.

Vogel A, Petersen S, Schlaggar B . The left occipitotemporal cortex does not show preferential activity for words. Cereb Cortex. 2012; 22(12):2715-32. PMC: 3491762. DOI: 10.1093/cercor/bhr295. View

19.

Martin L, Durisko C, Moore M, Coutanche M, Chen D, Fiez J . The VWFA Is the Home of Orthographic Learning When Houses Are Used as Letters. eNeuro. 2019; 6(1). PMC: 6378324. DOI: 10.1523/ENEURO.0425-17.2019. View

20.

Qu J, Pang Y, Liu X, Cao Y, Huang C, Mei L . Task modulates the orthographic and phonological representations in the bilateral ventral Occipitotemporal cortex. Brain Imaging Behav. 2022; 16(4):1695-1707. DOI: 10.1007/s11682-022-00641-w. View