» Articles » PMID: 38706520

Natural Language Syntax Complies with the Free-energy Principle

Overview
Journal Synthese
Date 2024 May 6
PMID 38706520
Authors
Affiliations
Soon will be listed here.
Abstract

Natural language syntax yields an unbounded array of hierarchically structured expressions. We claim that these are used in the service of active inference in accord with the free-energy principle (FEP). While conceptual advances alongside modelling and simulation work have attempted to connect speech segmentation and linguistic communication with the FEP, we extend this program to the underlying computations responsible for generating syntactic objects. We argue that recently proposed principles of economy in language design-such as "minimal search" criteria from theoretical syntax-adhere to the FEP. This affords a greater degree of explanatory power to the FEP-with respect to higher language functions-and offers linguistics a grounding in first principles with respect to computability. While we mostly focus on building new principled conceptual relations between syntax and the FEP, we also show through a sample of preliminary examples how both tree-geometric depth and a Kolmogorov complexity estimate (recruiting a Lempel-Ziv compression algorithm) can be used to accurately predict legal operations on syntactic workspaces, directly in line with formulations of variational free energy minimization. This is used to motivate a general principle of language design that we term Turing-Chomsky Compression (TCC). We use TCC to align concerns of linguists with the normative account of self-organization furnished by the FEP, by marshalling evidence from theoretical linguistics and psycholinguistics to ground core principles of efficient syntactic computation within active inference.

Citing Articles

Intraoperative cortical localization of music and language reveals signatures of structural complexity in posterior temporal cortex.

McCarty M, Murphy E, Scherschligt X, Woolnough O, Morse C, Snyder K iScience. 2023; 26(7):107223.

PMID: 37485361 PMC: 10362292. DOI: 10.1016/j.isci.2023.107223.


Models of the Translation Process and the Free Energy Principle.

Carl M Entropy (Basel). 2023; 25(6).

PMID: 37372272 PMC: 10296977. DOI: 10.3390/e25060928.


ROSE: A Neurocomputational Architecture for Syntax.

Murphy E ArXiv. 2023; .

PMID: 36994166 PMC: 10055479.


The Bayesian brain and cooperative communication in schizophrenia.

Palaniyappan L, Venkatasubramanian G J Psychiatry Neurosci. 2022; 47(1):E48-E54.

PMID: 35135834 PMC: 8834248. DOI: 10.1503/jpn.210231.

References
1.
Murphy E, Woolnough O, Rollo P, Roccaforte Z, Segaert K, Hagoort P . Minimal Phrase Composition Revealed by Intracranial Recordings. J Neurosci. 2022; 42(15):3216-3227. PMC: 8994536. DOI: 10.1523/JNEUROSCI.1575-21.2022. View

2.
Bourguignon M, Molinaro N, Lizarazu M, Taulu S, Jousmaki V, Lallier M . Neocortical activity tracks the hierarchical linguistic structures of self-produced speech during reading aloud. Neuroimage. 2020; 216:116788. DOI: 10.1016/j.neuroimage.2020.116788. View

3.
Chater N, Vitanyi P . Simplicity: a unifying principle in cognitive science?. Trends Cogn Sci. 2003; 7(1):19-22. DOI: 10.1016/s1364-6613(02)00005-0. View

4.
Ramstead M, Kirchhoff M, Constant A, Friston K . Multiscale integration: beyond internalism and externalism. Synthese. 2021; 198(Suppl 1):41-70. PMC: 7873008. DOI: 10.1007/s11229-019-02115-x. View

5.
Berwick R, Friederici A, Chomsky N, Bolhuis J . Evolution, brain, and the nature of language. Trends Cogn Sci. 2013; 17(2):89-98. DOI: 10.1016/j.tics.2012.12.002. View