Visuo-haptic Multisensory Object Recognition, Categorization, and Representation

Overview

Journal Front Psychol

Date 2014 Aug 8

PMID 25101014

Citations 30

Authors

Simon Lacey

K Sathian

Affiliations

Soon will be listed here.

Abstract

Visual and haptic unisensory object processing show many similarities in terms of categorization, recognition, and representation. In this review, we discuss how these similarities contribute to multisensory object processing. In particular, we show that similar unisensory visual and haptic representations lead to a shared multisensory representation underlying both cross-modal object recognition and view-independence. This shared representation suggests a common neural substrate and we review several candidate brain regions, previously thought to be specialized for aspects of visual processing, that are now known also to be involved in analogous haptic tasks. Finally, we lay out the evidence for a model of multisensory object recognition in which top-down and bottom-up pathways to the object-selective lateral occipital complex are modulated by object familiarity and individual differences in object and spatial imagery.

Citing Articles

Resting-State Network Plasticity Following Category Learning Depends on Sensory Modality.

Tabrik S, Dinse H, Tegenthoff M, Behroozi M Hum Brain Mapp. 2024; 45(18):e70111.

PMID: 39720915 PMC: 11669188. DOI: 10.1002/hbm.70111.

PHONETIC UNDERPINNINGS OF SOUND SYMBOLISM ACROSS MULTIPLE DOMAINS OF MEANING.

Lacey S, Matthews K, Sathian K, Nygaard L bioRxiv. 2024; .

PMID: 39282365 PMC: 11398306. DOI: 10.1101/2024.09.03.610970.

Exploring virtual reality object perception following sensory-motor interactions with different visuo-haptic collider properties.

Girondini M, Montanaro M, Gallace A Sci Rep. 2024; 14(1):10011.

PMID: 38693174 PMC: 11063216. DOI: 10.1038/s41598-024-59570-x.

Sensory substitution increases robotic surgical performance and sets the ground for a mediating role of the sense of embodiment: a systematic review.

Cesari V, Melfi F, Gemignani A, Menicucci D Heliyon. 2023; 9(11):e21665.

PMID: 38027699 PMC: 10656242. DOI: 10.1016/j.heliyon.2023.e21665.

Early blindness modulates haptic object recognition.

Leo F, Gori M, Sciutti A Front Hum Neurosci. 2022; 16:941593.

PMID: 36158621 PMC: 9498977. DOI: 10.3389/fnhum.2022.941593.

References

Iriki A, Tanaka M, Iwamura Y . Attention-induced neuronal activity in the monkey somatosensory cortex revealed by pupillometrics. Neurosci Res. 1996; 25(2):173-81. DOI: 10.1016/0168-0102(96)01043-7. View

De Santis L, Spierer L, Clarke S, Murray M . Getting in touch: segregated somatosensory what and where pathways in humans revealed by electrical neuroimaging. Neuroimage. 2007; 37(3):890-903. DOI: 10.1016/j.neuroimage.2007.05.052. View

Axelrod V, Yovel G . Hierarchical processing of face viewpoint in human visual cortex. J Neurosci. 2012; 32(7):2442-52. PMC: 6621816. DOI: 10.1523/JNEUROSCI.4770-11.2012. View

Harel A, Kravitz D, Baker C . Beyond perceptual expertise: revisiting the neural substrates of expert object recognition. Front Hum Neurosci. 2014; 7:885. PMC: 3873520. DOI: 10.3389/fnhum.2013.00885. View

Klatzky R, Lederman S . Identifying objects from a haptic glance. Percept Psychophys. 1995; 57(8):1111-23. DOI: 10.3758/bf03208368. View

Nabeta T, Kawahara J . Congruency effect of presentation modality on false recognition of haptic and visual objects. Memory. 2006; 14(3):307-15. DOI: 10.1080/09658210500277398. View

Amedi A, von Kriegstein K, van Atteveldt N, Beauchamp M, Naumer M . Functional imaging of human crossmodal identification and object recognition. Exp Brain Res. 2005; 166(3-4):559-71. DOI: 10.1007/s00221-005-2396-5. View

Zhou Y, Fuster J . Neuronal activity of somatosensory cortex in a cross-modal (visuo-haptic) memory task. Exp Brain Res. 1998; 116(3):551-5. DOI: 10.1007/pl00005783. View

Mullin C, Steeves J . TMS to the lateral occipital cortex disrupts object processing but facilitates scene processing. J Cogn Neurosci. 2011; 23(12):4174-84. DOI: 10.1162/jocn_a_00095. View

10.

Gallace A, Spence C . The cognitive and neural correlates of tactile memory. Psychol Bull. 2009; 135(3):380-406. DOI: 10.1037/a0015325. View

11.

Dijkerman H, de Haan E . Somatosensory processes subserving perception and action. Behav Brain Sci. 2007; 30(2):189-201. DOI: 10.1017/S0140525X07001392. View

12.

Deshpande G, Hu X, Lacey S, Stilla R, Sathian K . Object familiarity modulates effective connectivity during haptic shape perception. Neuroimage. 2009; 49(3):1991-2000. PMC: 3073838. DOI: 10.1016/j.neuroimage.2009.08.052. View

13.

Andresen D, Vinberg J, Grill-Spector K . The representation of object viewpoint in human visual cortex. Neuroimage. 2008; 45(2):522-36. PMC: 4415527. DOI: 10.1016/j.neuroimage.2008.11.009. View

14.

Pascual-Leone A, Hamilton R . The metamodal organization of the brain. Prog Brain Res. 2001; 134:427-45. DOI: 10.1016/s0079-6123(01)34028-1. View

15.

Helbig H, Ernst M . Optimal integration of shape information from vision and touch. Exp Brain Res. 2007; 179(4):595-606. DOI: 10.1007/s00221-006-0814-y. View

16.

Grill-Spector K, Kushnir T, Edelman S, Avidan G, Itzchak Y, Malach R . Differential processing of objects under various viewing conditions in the human lateral occipital complex. Neuron. 2000; 24(1):187-203. DOI: 10.1016/s0896-6273(00)80832-6. View

17.

Nicholson K, Humphrey G . The effect of colour congruency on shape discriminations of novel objects. Perception. 2004; 33(3):339-53. DOI: 10.1068/p5136. View

18.

Casey S, Newell F . Are representations of unfamiliar faces independent of encoding modality?. Neuropsychologia. 2006; 45(3):506-13. DOI: 10.1016/j.neuropsychologia.2006.02.011. View

19.

Cant J, Goodale M . Attention to form or surface properties modulates different regions of human occipitotemporal cortex. Cereb Cortex. 2006; 17(3):713-31. DOI: 10.1093/cercor/bhk022. View

20.

Woods A, OModhrain S, Newell F . The effect of temporal delay and spatial differences on cross-modal object recognition. Cogn Affect Behav Neurosci. 2004; 4(2):260-9. DOI: 10.3758/cabn.4.2.260. View