» Articles » PMID: 32640180

It's About Time: Minimizing Hardware and Software Latencies in Speech Research With Real-Time Auditory Feedback

Overview
Date 2020 Jul 9
PMID 32640180
Citations 23
Authors
Affiliations
Soon will be listed here.
Abstract

Purpose Various aspects of speech production related to auditory-motor integration and learning have been examined through auditory feedback perturbation paradigms in which participants' acoustic speech output is experimentally altered and played back via earphones/headphones "in real time." Scientific rigor requires high precision in determining and reporting the involved hardware and software latencies. Many reports in the literature, however, are not consistent with the minimum achievable latency for a given experimental setup. Here, we focus specifically on this methodological issue associated with implementing real-time auditory feedback perturbations, and we offer concrete suggestions for increased reproducibility in this particular line of work. Method Hardware and software latencies as well as total feedback loop latency were measured for formant perturbation studies with the Audapter software. Measurements were conducted for various audio interfaces, desktop and laptop computers, and audio drivers. An approach for lowering Audapter's software latency through nondefault parameter specification was also tested. Results Oft-overlooked hardware-specific latencies were not negligible for some of the tested audio interfaces (adding up to 15 ms). Total feedback loop latencies (including both hardware and software latency) were also generally larger than claimed in the literature. Nondefault parameter values can improve Audapter's own processing latency without negative impact on formant tracking. Conclusions Audio interface selection and software parameter optimization substantially affect total feedback loop latency. Thus, the actual total latency (hardware plus software) needs to be correctly measured and described in all published reports. Future speech research with "real-time" auditory feedback perturbations should increase scientific rigor by minimizing this latency.

Citing Articles

Dataset of speech produced with delayed auditory feedback.

Heyne M, Tardif M, Ocampo A, Petitjean A, Hacker E, Fox C Data Brief. 2025; 59:111300.

PMID: 39925387 PMC: 11803211. DOI: 10.1016/j.dib.2025.111300.


Does pre-speech auditory modulation reflect processes related to feedback monitoring or speech movement planning?.

Li J, Daliri A, Kim K, Max L Neurosci Lett. 2024; 843():138025.

PMID: 39461704 PMC: 11707600. DOI: 10.1016/j.neulet.2024.138025.


Divided Attention Has Limited Effects on Speech Sensorimotor Control.

Krakauer J, Naber C, Niziolek C, Parrell B J Speech Lang Hear Res. 2024; 67(11):4358-4368.

PMID: 39418590 PMC: 11567081. DOI: 10.1044/2024_JSLHR-24-00098.


Sensorimotor adaptation to a nonuniform formant perturbation generalizes to untrained vowels.

Parrell B, Niziolek C, Chen T J Neurophysiol. 2024; 132(5):1437-1444.

PMID: 39356074 PMC: 11573274. DOI: 10.1152/jn.00240.2024.


Audiomotor prediction errors drive speech adaptation even in the absence of overt movement.

Parrell B, Naber C, Kim O, Nizolek C, McDougle S bioRxiv. 2024; .

PMID: 39185222 PMC: 11343123. DOI: 10.1101/2024.08.13.607718.


References
1.
Houde J, Jordan M . Sensorimotor adaptation of speech I: Compensation and adaptation. J Speech Lang Hear Res. 2002; 45(2):295-310. DOI: 10.1044/1092-4388(2002/023). View

2.
Mollaei F, Shiller D, Baum S, Gracco V . Sensorimotor control of vocal pitch and formant frequencies in Parkinson's disease. Brain Res. 2016; 1646:269-277. PMC: 4975987. DOI: 10.1016/j.brainres.2016.06.013. View

3.
Ballard K, Halaki M, Sowman P, Kha A, Daliri A, Robin D . An Investigation of Compensation and Adaptation to Auditory Perturbations in Individuals With Acquired Apraxia of Speech. Front Hum Neurosci. 2019; 12:510. PMC: 6305734. DOI: 10.3389/fnhum.2018.00510. View

4.
Behroozmand R, Karvelis L, Liu H, Larson C . Vocalization-induced enhancement of the auditory cortex responsiveness during voice F0 feedback perturbation. Clin Neurophysiol. 2009; 120(7):1303-12. PMC: 2710429. DOI: 10.1016/j.clinph.2009.04.022. View

5.
Daliri A, Wieland E, Cai S, Guenther F, Chang S . Auditory-motor adaptation is reduced in adults who stutter but not in children who stutter. Dev Sci. 2017; 21(2). PMC: 5581739. DOI: 10.1111/desc.12521. View