» Articles » PMID: 18988858

"Who" is Saying "what"? Brain-based Decoding of Human Voice and Speech

Overview
Journal Science
Specialty Science
Date 2008 Nov 8
PMID 18988858
Citations 220
Authors
Affiliations
Soon will be listed here.
Abstract

Can we decipher speech content ("what" is being said) and speaker identity ("who" is saying it) from observations of brain activity of a listener? Here, we combine functional magnetic resonance imaging with a data-mining algorithm and retrieve what and whom a person is listening to from the neural fingerprints that speech and voice signals elicit in the listener's auditory cortex. These cortical fingerprints are spatially distributed and insensitive to acoustic variations of the input so as to permit the brain-based recognition of learned speech from unknown speakers and of learned voices from previously unheard utterances. Our findings unravel the detailed cortical layout and computational properties of the neural populations at the basis of human speech recognition and speaker identification.

Citing Articles

Introducing the Sisu Voice Matching Test (SVMT): A novel tool for assessing voice discrimination in Chinese.

Xu T, Jiang X, Zhang P, Wang A Behav Res Methods. 2025; 57(3):86.

PMID: 39900852 DOI: 10.3758/s13428-025-02608-3.


Multisensory naturalistic decoding with high-density diffuse optical tomography.

Tripathy K, Markow Z, Fogarty M, Schroeder M, Svoboda A, Eggebrecht A Neurophotonics. 2025; 12(1):015002.

PMID: 39850351 PMC: 11755382. DOI: 10.1117/1.NPh.12.1.015002.


Neuroimaging Findings for the Overnight Consolidation of Learned Non-native Speech Sounds.

Earle F, Molfese P, Myers E Neurobiol Lang (Camb). 2025; 6.

PMID: 39830070 PMC: 11740156. DOI: 10.1162/nol_a_00157.


Mediterranean diet and brain functional connectivity in a population without dementia.

Karavasilis E, Balomenos V, Christidi F, Velonakis G, Angelopoulou G, Yannakoulia M Front Neuroimaging. 2024; 3:1473399.

PMID: 39713787 PMC: 11659224. DOI: 10.3389/fnimg.2024.1473399.


Consciousness Under the Spotlight: The Problem of Measuring Subjective Experience.

Jimenez M, Prieto A, Hinojosa J, Montoro P Wiley Interdiscip Rev Cogn Sci. 2024; 16(1):e1697.

PMID: 39449331 PMC: 11652689. DOI: 10.1002/wcs.1697.