Combined Spectral and Temporal Enhancement to Improve Cochlear-implant Speech Perception

Overview

Journal J Acoust Soc Am

Publisher American Institute of Physics

Specialty Otorhinolaryngology

Date 2011 Nov 18

PMID 22087923

Citations 4

Authors

Aparajita Bhattacharya

Andrew Vandali

Fan-Gang Zeng

Affiliations

Soon will be listed here.

Abstract

The present study examined the effect of combined spectral and temporal enhancement on speech recognition by cochlear-implant (CI) users in quiet and in noise. The spectral enhancement was achieved by expanding the short-term Fourier amplitudes in the input signal. Additionally, a variation of the Transient Emphasis Spectral Maxima (TESM) strategy was applied to enhance the short-duration consonant cues that are otherwise suppressed when processed with spectral expansion. Nine CI users were tested on phoneme recognition tasks and ten CI users were tested on sentence recognition tasks both in quiet and in steady, speech-spectrum-shaped noise. Vowel and consonant recognition in noise were significantly improved with spectral expansion combined with TESM. Sentence recognition improved with both spectral expansion and spectral expansion combined with TESM. The amount of improvement varied with individual CI users. Overall the present results suggest that customized processing is needed to optimize performance according to not only individual users but also listening conditions.

Citing Articles

Cochlear Implant Users can Effectively Combine Place and Timing Cues for Pitch Perception.

Goldsworthy R, Bissmeyer S Ear Hear. 2023; 44(6):1410-1422.

PMID: 37788011 PMC: 10593103. DOI: 10.1097/AUD.0000000000001383.

Audibility emphasis of low-level sounds improves consonant identification while preserving vowel identification for cochlear implant users.

Goldsworthy R, Bissmeyer S, Swaminathan J Speech Commun. 2022; 137:52-59.

PMID: 35937542 PMC: 9351334. DOI: 10.1016/j.specom.2022.01.001.

Effect of Noise Reduction Gain Errors on Simulated Cochlear Implant Speech Intelligibility.

Kressner A, May T, Dau T Trends Hear. 2019; 23:2331216519825930.

PMID: 30755108 PMC: 6378641. DOI: 10.1177/2331216519825930.

Discrimination of Voice Pitch and Vocal-Tract Length in Cochlear Implant Users.

Gaudrain E, Baskent D Ear Hear. 2017; 39(2):226-237.

PMID: 28799983 PMC: 5839701. DOI: 10.1097/AUD.0000000000000480.

References

Baer T, Moore B, Gatehouse S . Spectral contrast enhancement of speech in noise for listeners with sensorineural hearing impairment: effects on intelligibility, quality, and response times. J Rehabil Res Dev. 1993; 30(1):49-72. View

Zeng F, Nie K, Stickney G, Kong Y, Vongphoe M, Bhargave A . Speech recognition with amplitude and frequency modulations. Proc Natl Acad Sci U S A. 2005; 102(7):2293-8. PMC: 546014. DOI: 10.1073/pnas.0406460102. View

Hillenbrand J, Getty L, Clark M, Wheeler K . Acoustic characteristics of American English vowels. J Acoust Soc Am. 1995; 97(5 Pt 1):3099-111. DOI: 10.1121/1.411872. View

Stevens K . Toward a model for lexical access based on acoustic landmarks and distinctive features. J Acoust Soc Am. 2002; 111(4):1872-91. DOI: 10.1121/1.1458026. View

Cohen L . Practical model description of peripheral neural excitation in cochlear implant recipients: 2. Spread of the effective stimulation field (ESF), from ECAP and FEA. Hear Res. 2008; 247(2):100-11. DOI: 10.1016/j.heares.2008.11.004. View

Busby P, Tong Y, Clark G . Electrode position, repetition rate, and speech perception by early- and late-deafened cochlear implant patients. J Acoust Soc Am. 1993; 93(2):1058-67. DOI: 10.1121/1.405554. View

Clarkson P, Bahgat S . Envelope expansion methods for speech enhancement. J Acoust Soc Am. 1991; 89(3):1378-82. DOI: 10.1121/1.400538. View

Li N, Loizou P . The contribution of obstruent consonants and acoustic landmarks to speech recognition in noise. J Acoust Soc Am. 2009; 124(6):3947. PMC: 2676629. DOI: 10.1121/1.2997435. View

Vandali A . Emphasis of short-duration acoustic speech cues for cochlear implant users. J Acoust Soc Am. 2001; 109(5 Pt 1):2049-61. DOI: 10.1121/1.1358300. View

10.

Wang M, BILGER R . Consonant confusions in noise: a study of perceptual features. J Acoust Soc Am. 1973; 54(5):1248-66. DOI: 10.1121/1.1914417. View

11.

Nelson P, Jin S, Carney A, Nelson D . Understanding speech in modulated interference: cochlear implant users and normal-hearing listeners. J Acoust Soc Am. 2003; 113(2):961-8. DOI: 10.1121/1.1531983. View

12.

Oxenham A, Simonson A, Turicchia L, Sarpeshkar R . Evaluation of companding-based spectral enhancement using simulated cochlear-implant processing. J Acoust Soc Am. 2007; 121(3):1709-16. DOI: 10.1121/1.2434757. View

13.

Stickney G, Zeng F, Litovsky R, Assmann P . Cochlear implant speech recognition with speech maskers. J Acoust Soc Am. 2004; 116(2):1081-91. DOI: 10.1121/1.1772399. View

14.

Montgomery A, EDGE R . Evaluation of two speech enhancement techniques to improve intelligibility for hearing-impaired adults. J Speech Hear Res. 1988; 31(3):386-93. DOI: 10.1044/jshr.3103.386. View

15.

Bhattacharya A, Zeng F . Companding to improve cochlear-implant speech recognition in speech-shaped noise. J Acoust Soc Am. 2007; 122(2):1079-89. DOI: 10.1121/1.2749710. View

16.

Loizou P, Poroy O . Minimum spectral contrast needed for vowel identification by normal hearing and cochlear implant listeners. J Acoust Soc Am. 2001; 110(3 Pt 1):1619-27. DOI: 10.1121/1.1388004. View

17.

Lyzenga J, Festen J, Houtgast T . A speech enhancement scheme incorporating spectral expansion evaluated with simulated loss of frequency selectivity. J Acoust Soc Am. 2002; 112(3 Pt 1):1145-57. DOI: 10.1121/1.1497619. View

18.

Bunnell H . On enhancement of spectral contrast in speech for hearing-impaired listeners. J Acoust Soc Am. 1990; 88(6):2546-56. DOI: 10.1121/1.399976. View

19.

Dorman M, Loizou P, Fitzke J, Tu Z . The recognition of sentences in noise by normal-hearing listeners using simulations of cochlear-implant signal processors with 6-20 channels. J Acoust Soc Am. 1998; 104(6):3583-5. DOI: 10.1121/1.423940. View

20.

Zeng F, Galvin 3rd J . Amplitude mapping and phoneme recognition in cochlear implant listeners. Ear Hear. 1999; 20(1):60-74. DOI: 10.1097/00003446-199902000-00006. View