Tactile and Bone-conduction Auditory Brain Computer Interface for Vision and Hearing Impaired Users
Overview
Authors
Affiliations
Background: The paper presents a report on the recently developed BCI alternative for users suffering from impaired vision (lack of focus or eye-movements) or from the so-called "ear-blocking-syndrome" (limited hearing). We report on our recent studies of the extents to which vibrotactile stimuli delivered to the head of a user can serve as a platform for a brain computer interface (BCI) paradigm.
New Method: In the proposed tactile and bone-conduction auditory BCI novel multiple head positions are used to evoke combined somatosensory and auditory (via the bone conduction effect) P300 brain responses, in order to define a multimodal tactile and bone-conduction auditory brain computer interface (tbcaBCI). In order to further remove EEG interferences and to improve P300 response classification synchrosqueezing transform (SST) is applied. SST outperforms the classical time-frequency analysis methods of the non-linear and non-stationary signals such as EEG. The proposed method is also computationally more effective comparing to the empirical mode decomposition. The SST filtering allows for online EEG preprocessing application which is essential in the case of BCI.
Results: Experimental results with healthy BCI-naive users performing online tbcaBCI, validate the paradigm, while the feasibility of the concept is illuminated through information transfer rate case studies.
Comparison With Existing Method(s): We present a comparison of the proposed SST-based preprocessing method, combined with a logistic regression (LR) classifier, together with classical preprocessing and LDA-based classification BCI techniques.
Conclusions: The proposed tbcaBCI paradigm together with data-driven preprocessing methods are a step forward in robust BCI applications research.
Rutkowski T, Komendzinski T, Otake-Matsuura M Front Aging Neurosci. 2024; 15:1294139.
PMID: 38239487 PMC: 10794306. DOI: 10.3389/fnagi.2023.1294139.
Rutkowski T, S Abe M, Komendzinski T, Sugimoto H, Narebski S, Otake-Matsuura M Front Hum Neurosci. 2023; 17:1155194.
PMID: 37397858 PMC: 10311997. DOI: 10.3389/fnhum.2023.1155194.
Effects of Skin Friction on Tactile P300 Brain-Computer Interface Performance.
Mao Y, Jin J, Li S, Miao Y, Cichocki A Comput Intell Neurosci. 2021; 2021:6694310.
PMID: 33628218 PMC: 7886524. DOI: 10.1155/2021/6694310.
Browarska N, Kawala-Sterniuk A, Zygarlicki J, Podpora M, Pelc M, Martinek R Brain Sci. 2021; 11(1).
PMID: 33451080 PMC: 7828570. DOI: 10.3390/brainsci11010098.
Sosulski J, Kemmer J, Tangermann M Neuroinformatics. 2020; 19(3):461-476.
PMID: 33319332 PMC: 8233254. DOI: 10.1007/s12021-020-09501-8.