Slow and Steady: Auditory Features for Discriminating Animal Vocalizations

Overview

Journal bioRxiv

Date 2024 Jul 15

PMID 39005308

Authors

Ronald W Di Tullio

Linran Wei

Vijay Balasubramanian

Affiliations

Soon will be listed here.

Abstract

We propose that listeners can use temporal regularities - spectro-temporal correlations that change smoothly over time - to discriminate animal vocalizations within and between species. To test this idea, we used Slow Feature Analysis (SFA) to find the most temporally regular components of vocalizations from birds (blue jay, house finch, American yellow warbler, and great blue heron), humans (English speakers), and rhesus macaques. We projected vocalizations into the learned feature space and tested intra-class (same speaker/species) and inter-class (different speakers/species) auditory discrimination by a trained classifier. We found that: 1) Vocalization discrimination was excellent (> 95%) in all cases; 2) Performance depended primarily on the ~10 most temporally regular features; 3) Most vocalizations are dominated by ~10 features with high temporal regularity; and 4) These regular features are highly correlated with the most predictable components of animal sounds.

References

Tesileanu T, Cocco S, Monasson R, Balasubramanian V . Adaptation of olfactory receptor abundances for efficient coding. Elife. 2019; 8. PMC: 6398974. DOI: 10.7554/eLife.39279. View

Gupta D, Mlynarski W, Sumser A, Symonova O, Svaton J, Joesch M . Panoramic visual statistics shape retina-wide organization of receptive fields. Nat Neurosci. 2023; 26(4):606-614. PMC: 10076217. DOI: 10.1038/s41593-023-01280-0. View

Escabi M, Schreiner C . Nonlinear spectrotemporal sound analysis by neurons in the auditory midbrain. J Neurosci. 2002; 22(10):4114-31. PMC: 6757655. DOI: 20026325. View

Peters R, Moore B, Baer T . Speech reception thresholds in noise with and without spectral and temporal dips for hearing-impaired and normally hearing people. J Acoust Soc Am. 1998; 103(1):577-87. DOI: 10.1121/1.421128. View

Tremblay S, Testard C, DiTullio R, Inchauspe J, Petrides M . Neural cognitive signals during spontaneous movements in the macaque. Nat Neurosci. 2022; 26(2):295-305. DOI: 10.1038/s41593-022-01220-4. View

Schwartz O, Simoncelli E . Natural signal statistics and sensory gain control. Nat Neurosci. 2001; 4(8):819-25. DOI: 10.1038/90526. View

Sprekeler H . On the relation of slow feature analysis and Laplacian eigenmaps. Neural Comput. 2011; 23(12):3287-302. DOI: 10.1162/NECO_a_00214. View

Gomez-Marin A, Paton J, Kampff A, Costa R, Mainen Z . Big behavioral data: psychology, ethology and the foundations of neuroscience. Nat Neurosci. 2014; 17(11):1455-62. DOI: 10.1038/nn.3812. View

Creutzig F, Sprekeler H . Predictive coding and the slowness principle: an information-theoretic approach. Neural Comput. 2007; 20(4):1026-41. DOI: 10.1162/neco.2008.01-07-455. View

10.

Zhuang X, Yang Z, Cordes D . A technical review of canonical correlation analysis for neuroscience applications. Hum Brain Mapp. 2020; 41(13):3807-3833. PMC: 7416047. DOI: 10.1002/hbm.25090. View

11.

Testard C, Tremblay S, Parodi F, DiTullio R, Acevedo-Ithier A, Gardiner K . Neural signatures of natural behaviour in socializing macaques. Nature. 2024; 628(8007):381-390. DOI: 10.1038/s41586-024-07178-6. View

12.

Turner R, Sahani M . A maximum-likelihood interpretation for slow feature analysis. Neural Comput. 2007; 19(4):1022-38. DOI: 10.1162/neco.2007.19.4.1022. View

13.

Fukushima M, Doyle A, Mullarkey M, Mishkin M, Averbeck B . Distributed acoustic cues for caller identity in macaque vocalization. R Soc Open Sci. 2016; 2(12):150432. PMC: 4806230. DOI: 10.1098/rsos.150432. View

14.

Woolley S, Fremouw T, Hsu A, Theunissen F . Tuning for spectro-temporal modulations as a mechanism for auditory discrimination of natural sounds. Nat Neurosci. 2005; 8(10):1371-9. DOI: 10.1038/nn1536. View

15.

Wei X, Prentice J, Balasubramanian V . A principle of economy predicts the functional architecture of grid cells. Elife. 2015; 4:e08362. PMC: 4616244. DOI: 10.7554/eLife.08362. View

16.

Testard C, Tremblay S, Platt M . From the field to the lab and back: neuroethology of primate social behavior. Curr Opin Neurobiol. 2021; 68:76-83. PMC: 8243779. DOI: 10.1016/j.conb.2021.01.005. View

17.

Kuang X, Poletti M, Victor J, Rucci M . Temporal encoding of spatial information during active visual fixation. Curr Biol. 2012; 22(6):510-4. PMC: 3332095. DOI: 10.1016/j.cub.2012.01.050. View

18.

Smith E, Lewicki M . Efficient auditory coding. Nature. 2006; 439(7079):978-82. DOI: 10.1038/nature04485. View

19.

Tabibi S, Kegel A, Lai W, Dillier N . Investigating the use of a Gammatone filterbank for a cochlear implant coding strategy. J Neurosci Methods. 2016; 277:63-74. PMC: 5270640. DOI: 10.1016/j.jneumeth.2016.12.004. View

20.

Singh N, Theunissen F . Modulation spectra of natural sounds and ethological theories of auditory processing. J Acoust Soc Am. 2004; 114(6 Pt 1):3394-411. DOI: 10.1121/1.1624067. View