A Hybrid P300-SSVEP Brain-computer Interface Speller with a Frequency Enhanced Row and Column Paradigm

Overview

Journal Front Neurosci

Date 2023 Apr 3

PMID 37008204

Authors

Xin Bai

Minglun Li

Shouliang Qi

Anna Ching Mei Ng

Tit Ng

Wei Qian

Affiliations

Soon will be listed here.

Abstract

Objective: This study proposes a new hybrid brain-computer interface (BCI) system to improve spelling accuracy and speed by stimulating P300 and steady-state visually evoked potential (SSVEP) in electroencephalography (EEG) signals.

Methods: A frequency enhanced row and column (FERC) paradigm is proposed to incorporate the frequency coding into the row and column (RC) paradigm so that the P300 and SSVEP signals can be evoked simultaneously. A flicker (white-black) with a specific frequency from 6.0 to 11.5 Hz with an interval of 0.5 Hz is assigned to one row or column of a 6 × 6 layout, and the row/column flashes are carried out in a pseudorandom sequence. A wavelet and support vector machine (SVM) combination is adopted for P300 detection, an ensemble task-related component analysis (TRCA) method is used for SSVEP detection, and the two detection possibilities are fused using a weight control approach.

Results: The implemented BCI speller achieved an accuracy of 94.29% and an information transfer rate (ITR) of 28.64 bit/min averaged across 10 subjects during the online tests. An accuracy of 96.86% is obtained during the offline calibration tests, higher than that of only using P300 (75.29%) or SSVEP (89.13%). The SVM in P300 outperformed the previous linear discrimination classifier and its variants (61.90-72.22%), and the ensemble TRCA in SSVEP outperformed the canonical correlation analysis method (73.33%).

Conclusion: The proposed hybrid FERC stimulus paradigm can improve the performance of the speller compared with the classical single stimulus paradigm. The implemented speller can achieve comparable accuracy and ITR to its state-of-the-art counterparts with advanced detection algorithms.

Citing Articles

Paradigms and methods of noninvasive brain-computer interfaces in motor or communication assistance and rehabilitation: a systematic review.

Meng J, Wei Y, Mai X, Li S, Wang X, Luo R Med Biol Eng Comput. 2025; .

PMID: 40059266 DOI: 10.1007/s11517-025-03340-y.

Hybrid BCI for Meal-Assist Robot Using Dry-Type EEG and Pupillary Light Reflex.

Ha J, Park S, Han Y, Kim L Biomimetics (Basel). 2025; 10(2).

PMID: 39997141 PMC: 11853533. DOI: 10.3390/biomimetics10020118.

The role of eye movement signals in non-invasive brain-computer interface typing system.

Liu X, Hu B, Si Y, Wang Q Med Biol Eng Comput. 2024; 62(7):1981-1990.

PMID: 38509350 DOI: 10.1007/s11517-024-03070-7.

A Novel Asynchronous Brain Signals-Based Driver-Vehicle Interface for Brain-Controlled Vehicles.

Lian J, Guo Y, Qiao X, Wang C, Bi L Bioengineering (Basel). 2023; 10(9).

PMID: 37760207 PMC: 10525223. DOI: 10.3390/bioengineering10091105.

Non-invasive EEG-based BCI spellers from the beginning to today: a mini-review.

Maslova O, Komarova Y, Shusharina N, Kolsanov A, Zakharov A, Garina E Front Hum Neurosci. 2023; 17:1216648.

PMID: 37680264 PMC: 10480564. DOI: 10.3389/fnhum.2023.1216648.

References

Kaufmann T, Herweg A, Kubler A . Toward brain-computer interface based wheelchair control utilizing tactually-evoked event-related potentials. J Neuroeng Rehabil. 2014; 11:7. PMC: 3898245. DOI: 10.1186/1743-0003-11-7. View

Jalilpour S, Sardouie S, Mijani A . A novel hybrid BCI speller based on RSVP and SSVEP paradigm. Comput Methods Programs Biomed. 2020; 187:105326. DOI: 10.1016/j.cmpb.2020.105326. View

Lee M, Kwon O, Kim Y, Kim H, Lee Y, Williamson J . EEG dataset and OpenBMI toolbox for three BCI paradigms: an investigation into BCI illiteracy. Gigascience. 2019; 8(5). PMC: 6501944. DOI: 10.1093/gigascience/giz002. View

Xu M, Chen L, Zhang L, Qi H, Ma L, Tang J . A visual parallel-BCI speller based on the time-frequency coding strategy. J Neural Eng. 2014; 11(2):026014. DOI: 10.1088/1741-2560/11/2/026014. View

Jiang J, Wang C, Wu J, Qin W, Xu M, Yin E . Temporal Combination Pattern Optimization Based on Feature Selection Method for Motor Imagery BCIs. Front Hum Neurosci. 2020; 14:231. PMC: 7344307. DOI: 10.3389/fnhum.2020.00231. View

Nakanishi M, Wang Y, Chen X, Wang Y, Gao X, Jung T . Enhancing Detection of SSVEPs for a High-Speed Brain Speller Using Task-Related Component Analysis. IEEE Trans Biomed Eng. 2017; 65(1):104-112. PMC: 5783827. DOI: 10.1109/TBME.2017.2694818. View

Chen X, Wang Y, Nakanishi M, Jung T, Gao X . Hybrid frequency and phase coding for a high-speed SSVEP-based BCI speller. Annu Int Conf IEEE Eng Med Biol Soc. 2015; 2014:3993-6. DOI: 10.1109/EMBC.2014.6944499. View

Panicker R, Puthusserypady S, Sun Y . An asynchronous P300 BCI with SSVEP-based control state detection. IEEE Trans Biomed Eng. 2011; 58(6):1781-8. DOI: 10.1109/TBME.2011.2116018. View

Pfurtscheller G, Solis-Escalante T, Ortner R, Linortner P, Muller-Putz G . Self-paced operation of an SSVEP-Based orthosis with and without an imagery-based "brain switch:" a feasibility study towards a hybrid BCI. IEEE Trans Neural Syst Rehabil Eng. 2010; 18(4):409-14. DOI: 10.1109/TNSRE.2010.2040837. View

10.

Gao X, Xu D, Cheng M, Gao S . A BCI-based environmental controller for the motion-disabled. IEEE Trans Neural Syst Rehabil Eng. 2003; 11(2):137-40. DOI: 10.1109/TNSRE.2003.814449. View

11.

Han J, Liu C, Chu J, Xiao X, Chen L, Xu M . Effects of inter-stimulus intervals on concurrent P300 and SSVEP features for hybrid brain-computer interfaces. J Neurosci Methods. 2022; 372:109535. DOI: 10.1016/j.jneumeth.2022.109535. View

12.

Onose G, Grozea C, Anghelescu A, Daia C, Sinescu C, Ciurea A . On the feasibility of using motor imagery EEG-based brain-computer interface in chronic tetraplegics for assistive robotic arm control: a clinical test and long-term post-trial follow-up. Spinal Cord. 2012; 50(8):599-608. DOI: 10.1038/sc.2012.14. View

13.

Xu M, Jia Y, Qi H, Hu Y, He F, Zhao X . Use of a steady-state baseline to address evoked vs. oscillation models of visual evoked potential origin. Neuroimage. 2016; 134:204-212. DOI: 10.1016/j.neuroimage.2016.03.073. View

14.

Han J, Xu M, Xiao X, Yi W, Jung T, Ming D . A high-speed hybrid brain-computer interface with more than 200 targets. J Neural Eng. 2023; 20(1). DOI: 10.1088/1741-2552/acb105. View

15.

Bin G, Gao X, Yan Z, Hong B, Gao S . An online multi-channel SSVEP-based brain-computer interface using a canonical correlation analysis method. J Neural Eng. 2009; 6(4):046002. DOI: 10.1088/1741-2560/6/4/046002. View

16.

Picton T . The P300 wave of the human event-related potential. J Clin Neurophysiol. 1992; 9(4):456-79. DOI: 10.1097/00004691-199210000-00002. View

17.

Li Y, Pan J, Wang F, Yu Z . A hybrid BCI system combining P300 and SSVEP and its application to wheelchair control. IEEE Trans Biomed Eng. 2013; 60(11):3156-66. DOI: 10.1109/TBME.2013.2270283. View

18.

Kapgate D, Kalbande D, Shrawankar U . An optimized facial stimuli paradigm for hybrid SSVEP+P300 brain computer interface. J Neurosurg Sci. 2019; 66(5):456-464. DOI: 10.23736/S0390-5616.19.04755-6. View

19.

Nakanishi M, Wang Y, Wang Y, Mitsukura Y, Jung T . A high-speed brain speller using steady-state visual evoked potentials. Int J Neural Syst. 2014; 24(6):1450019. DOI: 10.1142/S0129065714500191. View

20.

Li M, He D, Li C, Qi S . Brain-Computer Interface Speller Based on Steady-State Visual Evoked Potential: A Review Focusing on the Stimulus Paradigm and Performance. Brain Sci. 2021; 11(4). PMC: 8065759. DOI: 10.3390/brainsci11040450. View