» Articles » PMID: 33100508

Word Predictability Effects Are Linear, Not Logarithmic: Implications for Probabilistic Models of Sentence Comprehension

Overview
Journal J Mem Lang
Publisher Elsevier
Date 2020 Oct 26
PMID 33100508
Citations 27
Authors
Affiliations
Soon will be listed here.
Abstract

During language comprehension, we routinely use information from the prior context to help identify the meaning of individual words. While measures of online processing difficulty, such as reading times, are strongly influenced by contextual predictability, there is disagreement about the mechanisms underlying this lexical predictability effect, with different models predicting different linking functions - (Reichle, Rayner & Pollatsek, 2003) or (Levy, 2008). To help resolve this debate, we conducted two highly-powered experiments (self-paced reading, N = 216; cross-modal picture naming, N = 36), and a meta-analysis of prior eye-tracking while reading studies (total N = 218). We observed a robust relationship between lexical predictability and word processing times across all three studies. Beyond their methodological implications, these findings also place important constraints on predictive processing models of language comprehension. In particular, these results directly contradict the empirical predictions of , while supporting a of lexical prediction effects in comprehension.

Citing Articles

Emotional valence, cloze probability, and entropy: Completion norms for 403 French sentences.

Brunel J, Dujardin E, Delord S, Mathey S Behav Res Methods. 2025; 57(2):81.

PMID: 39890703 DOI: 10.3758/s13428-025-02604-7.


Moving beyond word frequency based on tally counting: AI-generated familiarity estimates of words and phrases are an interesting additional index of language knowledge.

Brysbaert M, Martinez G, Reviriego P Behav Res Methods. 2024; 57(1):28.

PMID: 39733132 DOI: 10.3758/s13428-024-02561-7.


Let them eat ceke: An electrophysiological study of form-based prediction in rich naturalistic contexts.

Yacovone A, Waite B, Levari T, Snedeker J J Exp Psychol Gen. 2024; 154(3):711-738.

PMID: 39680005 PMC: 11802317. DOI: 10.1037/xge0001677.


Prediction in reading: A review of predictability effects, their theoretical implications, and beyond.

Wong R, Reichle E, Veldre A Psychon Bull Rev. 2024; .

PMID: 39482486 DOI: 10.3758/s13423-024-02588-z.


Language models outperform cloze predictability in a cognitive model of reading.

Lopes Rego A, Snell J, Meeter M PLoS Comput Biol. 2024; 20(9):e1012117.

PMID: 39321153 PMC: 11458034. DOI: 10.1371/journal.pcbi.1012117.


References
1.
Laughlin S, de Ruyter van Steveninck R, Anderson J . The metabolic cost of neural information. Nat Neurosci. 1999; 1(1):36-41. DOI: 10.1038/236. View

2.
Kleinman D, Runnqvist E, Ferreira V . Single-word predictions of upcoming language during comprehension: Evidence from the cumulative semantic interference task. Cogn Psychol. 2015; 79:68-101. PMC: 4457568. DOI: 10.1016/j.cogpsych.2015.04.001. View

3.
Van Petten C, Luka B . Prediction during language comprehension: benefits, costs, and ERP components. Int J Psychophysiol. 2011; 83(2):176-90. DOI: 10.1016/j.ijpsycho.2011.09.015. View

4.
Just M, Carpenter P, Woolley J . Paradigms and processes in reading comprehension. J Exp Psychol Gen. 1982; 111(2):228-38. DOI: 10.1037//0096-3445.111.2.228. View

5.
DeLong K, Urbach T, Kutas M . Probabilistic word pre-activation during language comprehension inferred from electrical brain activity. Nat Neurosci. 2005; 8(8):1117-21. DOI: 10.1038/nn1504. View