Voice Emotion Perception and Production in Cochlear Implant Users

Overview

Journal Hear Res

Specialty Otorhinolaryngology

Date 2017 Jan 16

PMID 28088500

Citations 24

Authors

N T Jiam

M Caldwell

M L Deroche

M Chatterjee

C J Limb

Affiliations

Soon will be listed here.

Abstract

Voice emotion is a fundamental component of human social interaction and social development. Unfortunately, cochlear implant users are often forced to interface with highly degraded prosodic cues as a result of device constraints in extraction, processing, and transmission. As such, individuals with cochlear implants frequently demonstrate significant difficulty in recognizing voice emotions in comparison to their normal hearing counterparts. Cochlear implant-mediated perception and production of voice emotion is an important but relatively understudied area of research. However, a rich understanding of the voice emotion auditory processing offers opportunities to improve upon CI biomedical design and to develop training programs benefiting CI performance. In this review, we will address the issues, current literature, and future directions for improved voice emotion processing in cochlear implant users.

Citing Articles

Vocal Emotion Perception in Children Using Cochlear Implant.

Sahana P, Manjula P J Int Adv Otol. 2024; 20(5):383-389.

PMID: 39388519 PMC: 11562208. DOI: 10.5152/iao.2024.241480.

Investigation of Deficits in Auditory Emotional Content Recognition by Adult Cochlear Implant Users through the Study of Electroencephalographic Gamma and Alpha Asymmetry and Alexithymia Assessment.

Cartocci G, Inguscio B, Giorgi A, Rossi D, Di Nardo W, Di Cesare T Brain Sci. 2024; 14(9).

PMID: 39335422 PMC: 11430703. DOI: 10.3390/brainsci14090927.

Cochlear-implant simulated spectral degradation attenuates emotional responses to environmental sounds.

Jahn K, Wiegand-Shahani B, Moturi V, Kashiwagura S, Doak K Int J Audiol. 2024; :1-7.

PMID: 39146030 PMC: 11833750. DOI: 10.1080/14992027.2024.2385552.

The Jena Audiovisual Stimuli of Morphed Emotional Pseudospeech (JAVMEPS): A database for emotional auditory-only, visual-only, and congruent and incongruent audiovisual voice and dynamic face stimuli with varying voice intensities.

von Eiff C, Kauk J, Schweinberger S Behav Res Methods. 2023; 56(5):5103-5115.

PMID: 37821750 PMC: 11289065. DOI: 10.3758/s13428-023-02249-4.

Parental Competence as a Teacher in the Auditory Development of Children with Cochlear Implants.

Lukovenko T, Sikinbayev B, Shterts O, Mironova E J Psycholinguist Res. 2023; 52(6):2119-2133.

PMID: 37480449 DOI: 10.1007/s10936-023-09995-8.

References

Wang D, Trehub S, Volkova A, van Lieshout P . Child implant users' imitation of happy- and sad-sounding speech. Front Psychol. 2013; 4:351. PMC: 3689189. DOI: 10.3389/fpsyg.2013.00351. View

Peng S, Tomblin J, Spencer L, Hurtig R . Imitative production of rising speech intonation in pediatric cochlear implant recipients. J Speech Lang Hear Res. 2007; 50(5):1210-27. PMC: 3212410. DOI: 10.1044/1092-4388(2007/085). View

Gilbers S, Fuller C, Gilbers D, Broersma M, Goudbeek M, Free R . Normal-Hearing Listeners' and Cochlear Implant Users' Perception of Pitch Cues in Emotional Speech. Iperception. 2016; 6(5):0301006615599139. PMC: 5016815. DOI: 10.1177/0301006615599139. View

Juslin P, Laukka P . Impact of intended emotion intensity on cue utilization and decoding accuracy in vocal expression of emotion. Emotion. 2003; 1(4):381-412. DOI: 10.1037/1528-3542.1.4.381. View

Ekman P . Are there basic emotions?. Psychol Rev. 1992; 99(3):550-3. DOI: 10.1037/0033-295x.99.3.550. View

Scherer K . Vocal affect expression: a review and a model for future research. Psychol Bull. 1986; 99(2):143-65. View

Galvin 3rd J, Fu Q, Nogaki G . Melodic contour identification by cochlear implant listeners. Ear Hear. 2007; 28(3):302-19. PMC: 3627492. DOI: 10.1097/01.aud.0000261689.35445.20. View

ISSHIKI N . REGULATORY MECHANISM OF VOICE INTENSITY VARIATION. J Speech Hear Res. 1964; 7:17-29. DOI: 10.1044/jshr.0701.17. View

Lo C, McMahon C, Looi V, Thompson W . Melodic Contour Training and Its Effect on Speech in Noise, Consonant Discrimination, and Prosody Perception for Cochlear Implant Recipients. Behav Neurol. 2015; 2015:352869. PMC: 4606449. DOI: 10.1155/2015/352869. View

10.

Patel A . Can nonlinguistic musical training change the way the brain processes speech? The expanded OPERA hypothesis. Hear Res. 2013; 308:98-108. DOI: 10.1016/j.heares.2013.08.011. View

11.

Ciocca V, Francis A, Aisha R, Wong L . The perception of Cantonese lexical tones by early-deafened cochlear implantees. J Acoust Soc Am. 2002; 111(5 Pt 1):2250-6. DOI: 10.1121/1.1471897. View

12.

Chen J, Chuang A, McMahon C, Hsieh J, Tung T, Li L . Music training improves pitch perception in prelingually deafened children with cochlear implants. Pediatrics. 2010; 125(4):e793-800. DOI: 10.1542/peds.2008-3620. View

13.

Nakata T, Trehub S, Kanda Y . Effect of cochlear implants on children's perception and production of speech prosody. J Acoust Soc Am. 2012; 131(2):1307-14. DOI: 10.1121/1.3672697. View

14.

Holt C, McDermott H . Discrimination of intonation contours by adolescents with cochlear implants. Int J Audiol. 2013; 52(12):808-15. DOI: 10.3109/14992027.2013.832416. View

15.

Dyck M, Denver E . Can the Emotion Recognition Ability of Deaf Children be Enhanced? A Pilot Study. J Deaf Stud Deaf Educ. 2004; 8(3):348-56. DOI: 10.1093/deafed/eng019. View

16.

Breitenstein C, Van Lancker D, Daum I, WATERS C . Impaired perception of vocal emotions in Parkinson's disease: influence of speech time processing and executive functioning. Brain Cogn. 2001; 45(2):277-314. DOI: 10.1006/brcg.2000.1246. View

17.

He A, Deroche M, Doong J, Jiradejvong P, Limb C . Mandarin Tone Identification in Cochlear Implant Users Using Exaggerated Pitch Contours. Otol Neurotol. 2016; 37(4):324-31. DOI: 10.1097/MAO.0000000000000980. View

18.

See R, Driscoll V, Gfeller K, Kliethermes S, Oleson J . Speech intonation and melodic contour recognition in children with cochlear implants and with normal hearing. Otol Neurotol. 2013; 34(3):490-8. PMC: 3600096. DOI: 10.1097/MAO.0b013e318287c985. View

19.

Krumhansl C . An exploratory study of musical emotions and psychophysiology. Can J Exp Psychol. 1998; 51(4):336-53. DOI: 10.1037/1196-1961.51.4.336. View

20.

Kong Y, Mullangi A, Marozeau J, Epstein M . Temporal and spectral cues for musical timbre perception in electric hearing. J Speech Lang Hear Res. 2010; 54(3):981-94. PMC: 3107380. DOI: 10.1044/1092-4388(2010/10-0196). View