Concurrent Contextual and Time-distant Mnemonic Information Co-exist As Feedback in the Human Visual Cortex

Overview

Journal Neuroimage

Specialty Radiology

Date 2022 Dec 3

PMID 36462731

Authors

Javier Ortiz-Tudela

Johanna Bergmann

Matthew Bennett

Isabelle Ehrlich

Lars Muckli

Yee Lee Shing

Affiliations

Soon will be listed here.

Abstract

Efficient processing of the visual environment necessitates the integration of incoming sensory evidence with concurrent contextual inputs and mnemonic content from our past experiences. To examine how this integration takes place in the brain, we isolated different types of feedback signals from the neural patterns of non-stimulated areas of the early visual cortex in humans (i.e., V1 and V2). Using multivariate pattern analysis, we showed that both contextual and time-distant information, coexist in V1 and V2 as feedback signals. In addition, we found that the extent to which mnemonic information is reinstated in V1 and V2 depends on whether the information is retrieved episodically or semantically. Critically, this reinstatement was independent on the retrieval route in the object-selective cortex. These results demonstrate that our early visual processing contains not just direct and indirect information from the visual surrounding, but also memory-based predictions.

Citing Articles

RDoC Framework Through the Lens of Predictive Processing: Focusing on Cognitive Systems Domain.

Banaraki A, Toghi A, Mohammadzadeh A Comput Psychiatr. 2024; 8(1):178-201.

PMID: 39478691 PMC: 11523845. DOI: 10.5334/cpsy.119.

Schema-driven prediction effects on episodic memory across the lifespan.

Ortiz-Tudela J, Turan G, Vilas M, Melloni L, Lee Shing Y Philos Trans R Soc Lond B Biol Sci. 2024; 379(1913):20230401.

PMID: 39278241 PMC: 11449153. DOI: 10.1098/rstb.2023.0401.

Mnemonic But Not Contextual Feedback Signals Defy Dedifferentiation in the Aging Early Visual Cortex.

Ehrlich I, Ortiz-Tudela J, Tan Y, Muckli L, Lee Shing Y J Neurosci. 2024; 44(16).

PMID: 38395614 PMC: 11026335. DOI: 10.1523/JNEUROSCI.0607-23.2023.

Parameters of prediction: Multidimensional characterization of top-down influence in visual perception.

Ortiz-Tudela J, Nicholls V, Clarke A Neurosci Biobehav Rev. 2023; 153:105369.

PMID: 37619646 PMC: 7615211. DOI: 10.1016/j.neubiorev.2023.105369.

Effects of schema on the relationship between post-encoding brain connectivity and subsequent durable memory.

Guo D, Chen G, Yang J Sci Rep. 2023; 13(1):8736.

PMID: 37253795 PMC: 10229577. DOI: 10.1038/s41598-023-34822-4.

References

Kok P, Rait L, Turk-Browne N . Content-based Dissociation of Hippocampal Involvement in Prediction. J Cogn Neurosci. 2019; 32(3):527-545. PMC: 6996939. DOI: 10.1162/jocn_a_01509. View

Smith F, Muckli L . Nonstimulated early visual areas carry information about surrounding context. Proc Natl Acad Sci U S A. 2010; 107(46):20099-103. PMC: 2993348. DOI: 10.1073/pnas.1000233107. View

Abdulrahman H, Henson R . Effect of trial-to-trial variability on optimal event-related fMRI design: Implications for Beta-series correlation and multi-voxel pattern analysis. Neuroimage. 2015; 125:756-766. PMC: 4692520. DOI: 10.1016/j.neuroimage.2015.11.009. View

Rademaker R, Chunharas C, Serences J . Coexisting representations of sensory and mnemonic information in human visual cortex. Nat Neurosci. 2019; 22(8):1336-1344. PMC: 6857532. DOI: 10.1038/s41593-019-0428-x. View

Barron H, Auksztulewicz R, Friston K . Prediction and memory: A predictive coding account. Prog Neurobiol. 2020; 192:101821. PMC: 7305946. DOI: 10.1016/j.pneurobio.2020.101821. View

Rogers T, Hocking J, Mechelli A, Patterson K, Price C . Fusiform activation to animals is driven by the process, not the stimulus. J Cogn Neurosci. 2005; 17(3):434-45. DOI: 10.1162/0898929053279531. View

Ritchey M, Cooper R . Deconstructing the Posterior Medial Episodic Network. Trends Cogn Sci. 2020; 24(6):451-465. DOI: 10.1016/j.tics.2020.03.006. View

Serences J . Neural mechanisms of information storage in visual short-term memory. Vision Res. 2016; 128:53-67. PMC: 5079778. DOI: 10.1016/j.visres.2016.09.010. View

Kriegeskorte N, Mur M, Bandettini P . Representational similarity analysis - connecting the branches of systems neuroscience. Front Syst Neurosci. 2008; 2:4. PMC: 2605405. DOI: 10.3389/neuro.06.004.2008. View

10.

Press C, Kok P, Yon D . The Perceptual Prediction Paradox. Trends Cogn Sci. 2019; 24(1):13-24. DOI: 10.1016/j.tics.2019.11.003. View

11.

Rahnev D, Lau H, de Lange F . Prior expectation modulates the interaction between sensory and prefrontal regions in the human brain. J Neurosci. 2011; 31(29):10741-8. PMC: 6622631. DOI: 10.1523/JNEUROSCI.1478-11.2011. View

12.

Groen I, Greene M, Baldassano C, Fei-Fei L, Beck D, Baker C . Distinct contributions of functional and deep neural network features to representational similarity of scenes in human brain and behavior. Elife. 2018; 7. PMC: 5860866. DOI: 10.7554/eLife.32962. View

13.

Brodoehl S, Witte O, Klingner C . Measuring eye states in functional MRI. BMC Neurosci. 2016; 17(1):48. PMC: 4944461. DOI: 10.1186/s12868-016-0282-7. View

14.

Markov N, Ercsey-Ravasz M, Van Essen D, Knoblauch K, Toroczkai Z, Kennedy H . Cortical high-density counterstream architectures. Science. 2013; 342(6158):1238406. PMC: 3905047. DOI: 10.1126/science.1238406. View

15.

Dwivedi K, Cichy R, Roig G . Unraveling Representations in Scene-selective Brain Regions Using Scene-Parsing Deep Neural Networks. J Cogn Neurosci. 2020; 33(10):2032-2043. PMC: 7612022. DOI: 10.1162/jocn_a_01624. View

16.

Muckli L, De Martino F, Vizioli L, Petro L, Smith F, Ugurbil K . Contextual Feedback to Superficial Layers of V1. Curr Biol. 2015; 25(20):2690-5. PMC: 4612466. DOI: 10.1016/j.cub.2015.08.057. View

17.

Silson E, Steel A, Kidder A, Gilmore A, Baker C . Distinct subdivisions of human medial parietal cortex support recollection of people and places. Elife. 2019; 8. PMC: 6667275. DOI: 10.7554/eLife.47391. View

18.

Stokes M, Atherton K, Patai E, Nobre A . Long-term memory prepares neural activity for perception. Proc Natl Acad Sci U S A. 2011; 109(6):E360-7. PMC: 3277524. DOI: 10.1073/pnas.1108555108. View

19.

Binder J, Desai R, Graves W, Conant L . Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cereb Cortex. 2009; 19(12):2767-96. PMC: 2774390. DOI: 10.1093/cercor/bhp055. View

20.

Lawrence S, Norris D, de Lange F . Dissociable laminar profiles of concurrent bottom-up and top-down modulation in the human visual cortex. Elife. 2019; 8. PMC: 6538372. DOI: 10.7554/eLife.44422. View