Phoneme and Word Recognition in the Auditory Ventral Stream

Overview

Journal Proc Natl Acad Sci U S A

Specialty Science

Date 2012 Feb 7

PMID 22308358

Citations 198

Authors

Iain DeWitt

Josef P Rauschecker

Affiliations

Soon will be listed here.

Abstract

Spoken word recognition requires complex, invariant representations. Using a meta-analytic approach incorporating more than 100 functional imaging experiments, we show that preference for complex sounds emerges in the human auditory ventral stream in a hierarchical fashion, consistent with nonhuman primate electrophysiology. Examining speech sounds, we show that activation associated with the processing of short-timescale patterns (i.e., phonemes) is consistently localized to left mid-superior temporal gyrus (STG), whereas activation associated with the integration of phonemes into temporally complex patterns (i.e., words) is consistently localized to left anterior STG. Further, we show left mid- to anterior STG is reliably implicated in the invariant representation of phonetic forms and that this area also responds preferentially to phonetic sounds, above artificial control sounds or environmental sounds. Together, this shows increasing encoding specificity and invariance along the auditory ventral stream for temporally complex speech sounds.

Citing Articles

Building Multivariate Molecular Imaging Brain Atlases Using the NeuroMark PET Independent Component Analysis Framework.

Eierud C, Norgaard M, Bilgel M, Petropoulos H, Fu Z, Iraji A bioRxiv. 2025; .

PMID: 40027837 PMC: 11870563. DOI: 10.1101/2025.02.18.638362.

Parallel hierarchical encoding of linguistic representations in the human auditory cortex and recurrent automatic speech recognition systems.

Keshishian M, Mischler G, Thomas S, Kingsbury B, Bickel S, Mehta A bioRxiv. 2025; .

PMID: 39975377 PMC: 11838305. DOI: 10.1101/2025.01.30.635775.

Statistical learning beyond words in human neonates.

Flo A, Benjamin L, Palu M, Dehaene-Lambertz G Elife. 2025; 13.

PMID: 39960058 PMC: 11832168. DOI: 10.7554/eLife.101802.

Hearing in categories and speech perception at the "cocktail party".

Bidelman G, Bernard F, Skubic K PLoS One. 2025; 20(1):e0318600.

PMID: 39883695 PMC: 11781644. DOI: 10.1371/journal.pone.0318600.

Attenuated processing of vowels in the left temporal cortex predicts speech-in-noise perception deficit in children with autism.

Fadeev K, Romero Reyes I, Goiaeva D, Obukhova T, Ovsiannikova T, Prokofyev A J Neurodev Disord. 2024; 16(1):67.

PMID: 39643915 PMC: 11624601. DOI: 10.1186/s11689-024-09585-2.

References

Nath A, Beauchamp M . Dynamic changes in superior temporal sulcus connectivity during perception of noisy audiovisual speech. J Neurosci. 2011; 31(5):1704-14. PMC: 3050590. DOI: 10.1523/JNEUROSCI.4853-10.2011. View

Joanisse M, Zevin J, McCandliss B . Brain mechanisms implicated in the preattentive categorization of speech sounds revealed using FMRI and a short-interval habituation trial paradigm. Cereb Cortex. 2006; 17(9):2084-93. DOI: 10.1093/cercor/bhl124. View

Cappelle B, Shtyrov Y, Pulvermuller F . Heating up or cooling up the brain? MEG evidence that phrasal verbs are lexical units. Brain Lang. 2010; 115(3):189-201. DOI: 10.1016/j.bandl.2010.09.004. View

Humphries C, Binder J, Medler D, Liebenthal E . Syntactic and semantic modulation of neural activity during auditory sentence comprehension. J Cogn Neurosci. 2006; 18(4):665-79. PMC: 1635792. DOI: 10.1162/jocn.2006.18.4.665. View

Galaburda A, SANIDES F . Cytoarchitectonic organization of the human auditory cortex. J Comp Neurol. 1980; 190(3):597-610. DOI: 10.1002/cne.901900312. View

Dhanjal N, Handunnetthi L, Patel M, Wise R . Perceptual systems controlling speech production. J Neurosci. 2008; 28(40):9969-75. PMC: 6671273. DOI: 10.1523/JNEUROSCI.2607-08.2008. View

Graves W, Desai R, Humphries C, Seidenberg M, Binder J . Neural systems for reading aloud: a multiparametric approach. Cereb Cortex. 2009; 20(8):1799-815. PMC: 2901017. DOI: 10.1093/cercor/bhp245. View

Belin P, Zatorre R, Ahad P . Human temporal-lobe response to vocal sounds. Brain Res Cogn Brain Res. 2002; 13(1):17-26. DOI: 10.1016/s0926-6410(01)00084-2. View

Wise R, Scott S, Blank S, Mummery C, Murphy K, Warburton E . Separate neural subsystems within 'Wernicke's area'. Brain. 2001; 124(Pt 1):83-95. DOI: 10.1093/brain/124.1.83. View

10.

Poremba A, Malloy M, Saunders R, Carson R, Herscovitch P, Mishkin M . Species-specific calls evoke asymmetric activity in the monkey's temporal poles. Nature. 2004; 427(6973):448-51. DOI: 10.1038/nature02268. View

11.

Carr C, Konishi M . Axonal delay lines for time measurement in the owl's brainstem. Proc Natl Acad Sci U S A. 1988; 85(21):8311-5. PMC: 282419. DOI: 10.1073/pnas.85.21.8311. View

12.

Romanski L, Averbeck B . The primate cortical auditory system and neural representation of conspecific vocalizations. Annu Rev Neurosci. 2009; 32:315-46. PMC: 2767298. DOI: 10.1146/annurev.neuro.051508.135431. View

13.

Joseph J, Cerullo M, Farley A, Steinmetz N, Mier C . fMRI correlates of cortical specialization and generalization for letter processing. Neuroimage. 2006; 32(2):806-20. DOI: 10.1016/j.neuroimage.2006.04.175. View

14.

Flowers D, Jones K, Noble K, Vanmeter J, Zeffiro T, Wood F . Attention to single letters activates left extrastriate cortex. Neuroimage. 2004; 21(3):829-39. DOI: 10.1016/j.neuroimage.2003.10.002. View

15.

Atencio C, Sharpee T, Schreiner C . Hierarchical computation in the canonical auditory cortical circuit. Proc Natl Acad Sci U S A. 2009; 106(51):21894-9. PMC: 2799842. DOI: 10.1073/pnas.0908383106. View

16.

Brugge J, Merzenich M . Responses of neurons in auditory cortex of the macaque monkey to monaural and binaural stimulation. J Neurophysiol. 1973; 36(6):1138-58. DOI: 10.1152/jn.1973.36.6.1138. View

17.

Pegado F, Nakamura K, Cohen L, Dehaene S . Breaking the symmetry: mirror discrimination for single letters but not for pictures in the Visual Word Form Area. Neuroimage. 2010; 55(2):742-9. DOI: 10.1016/j.neuroimage.2010.11.043. View

18.

Marinkovic K, Dhond R, Dale A, Glessner M, Carr V, Halgren E . Spatiotemporal dynamics of modality-specific and supramodal word processing. Neuron. 2003; 38(3):487-97. PMC: 3746792. DOI: 10.1016/s0896-6273(03)00197-1. View

19.

Bates E, Wilson S, Saygin A, Dick F, Sereno M, Knight R . Voxel-based lesion-symptom mapping. Nat Neurosci. 2003; 6(5):448-50. DOI: 10.1038/nn1050. View

20.

Rauschecker J . An expanded role for the dorsal auditory pathway in sensorimotor control and integration. Hear Res. 2010; 271(1-2):16-25. PMC: 3021714. DOI: 10.1016/j.heares.2010.09.001. View