» Articles » PMID: 36777107

Combining Computational Controls with Natural Text Reveals Aspects of Meaning Composition

Overview
Journal Nat Comput Sci
Publisher Springer Nature
Specialties Biology
Science
Date 2023 Feb 13
PMID 36777107
Authors
Affiliations
Soon will be listed here.
Abstract

To study a core component of human intelligence-our ability to combine the meaning of words-neuroscientists have looked to linguistics. However, linguistic theories are insufficient to account for all brain responses reflecting linguistic composition. In contrast, we adopt a data-driven approach to study the composed meaning of words beyond their individual meaning, which we term 'supra-word meaning'. We construct a computational representation for supra-word meaning and study its brain basis through brain recordings from two complementary imaging modalities. Using functional magnetic resonance imaging, we reveal that hubs that are thought to process lexical meaning also maintain supra-word meaning, suggesting a common substrate for lexical and combinatorial semantics. Surprisingly, we cannot detect supra-word meaning in magnetoencephalography, which suggests that composed meaning might be maintained through a different neural mechanism than the synchronized firing of pyramidal cells. This sensitivity difference has implications for past neuroimaging results and future wearable neurotechnology.

Citing Articles

Divergences between Language Models and Human Brains.

Zhou Y, Liu E, Neubig G, Tarr M, Wehbe L ArXiv. 2025; .

PMID: 39876931 PMC: 11774444.


A conditional latent autoregressive recurrent model for generation and forecasting of beam dynamics in particle accelerators.

Rautela M, Williams A, Scheinker A Sci Rep. 2024; 14(1):18157.

PMID: 39103435 PMC: 11300895. DOI: 10.1038/s41598-024-68944-0.


A shared model-based linguistic space for transmitting our thoughts from brain to brain in natural conversations.

Zada Z, Goldstein A, Michelmann S, Simony E, Price A, Hasenfratz L Neuron. 2024; 112(18):3211-3222.e5.

PMID: 39096896 PMC: 11427153. DOI: 10.1016/j.neuron.2024.06.025.


Computational Language Modeling and the Promise of In Silico Experimentation.

Jain S, Vo V, Wehbe L, Huth A Neurobiol Lang (Camb). 2024; 5(1):80-106.

PMID: 38645624 PMC: 11025654. DOI: 10.1162/nol_a_00101.


Predictive Coding or Just Feature Discovery? An Alternative Account of Why Language Models Fit Brain Data.

Antonello R, Huth A Neurobiol Lang (Camb). 2024; 5(1):64-79.

PMID: 38645616 PMC: 11025645. DOI: 10.1162/nol_a_00087.


References
1.
Taulu S, Simola J . Spatiotemporal signal space separation method for rejecting nearby interference in MEG measurements. Phys Med Biol. 2006; 51(7):1759-68. DOI: 10.1088/0031-9155/51/7/008. View

2.
Lyu B, Choi H, Marslen-Wilson W, Clarke A, Randall B, Tyler L . Neural dynamics of semantic composition. Proc Natl Acad Sci U S A. 2019; 116(42):21318-21327. PMC: 6800340. DOI: 10.1073/pnas.1903402116. View

3.
Deniz F, Nunez-Elizalde A, Huth A, Gallant J . The Representation of Semantic Information Across Human Cerebral Cortex During Listening Versus Reading Is Invariant to Stimulus Modality. J Neurosci. 2019; 39(39):7722-7736. PMC: 6764208. DOI: 10.1523/JNEUROSCI.0675-19.2019. View

4.
Schrimpf M, Blank I, Tuckute G, Kauf C, Hosseini E, Kanwisher N . The neural architecture of language: Integrative modeling converges on predictive processing. Proc Natl Acad Sci U S A. 2021; 118(45). PMC: 8694052. DOI: 10.1073/pnas.2105646118. View

5.
Caucheteux C, King J . Brains and algorithms partially converge in natural language processing. Commun Biol. 2022; 5(1):134. PMC: 8850612. DOI: 10.1038/s42003-022-03036-1. View