Subcortical, Modality-specific Pathways Contribute to Multisensory Processing in Humans

Oftentimes, we perceive our environment by integrating information across multiple senses. Recent studies suggest that such integration occurs at much earlier processing stages than once thought possible, including in thalamic nuclei and putatively unisensory cortical brain regions. Here, we used diffusion tensor imaging (DTI) and an audiovisual integration task to test the hypothesis that anatomical connections between sensory-related subcortical structures and sensory cortical areas govern multisensory processing in humans. Twenty-five subjects (mean age 22 years, 22 females) participated in the study. In line with our hypothesis, we show that estimated strength of white-matter connections between the first relay station in the auditory processing stream (the cochlear nucleus), the auditory thalamus, and primary auditory cortex predicted one's ability to combine auditory and visual information in a visual search task. This finding supports a growing body of work that indicates that subcortical sensory pathways do not only feed forward unisensory information to the cortex, and suggests that anatomical brain connectivity contributes to multisensory processing ability in humans.