Noninvasive Electroencephalogram Based Control of a Robotic Arm for Writing Task Using Hybrid BCI System

Overview

Journal Biomed Res Int

Publisher Wiley

Specialties Biomedical Engineering
Biotechnology
General Medicine

Date 2017 Jun 30

PMID 28660211

Citations 18

Authors

Qiang Gao

Lixiang Dou

Abdelkader Nasreddine Belkacem

Chao Chen

Affiliations

Soon will be listed here.

Abstract

A novel hybrid brain-computer interface (BCI) based on the electroencephalogram (EEG) signal which consists of a motor imagery- (MI-) based online interactive brain-controlled switch, "teeth clenching" state detector, and a steady-state visual evoked potential- (SSVEP-) based BCI was proposed to provide multidimensional BCI control. MI-based BCI was used as single-pole double throw brain switch (SPDTBS). By combining the SPDTBS with 4-class SSEVP-based BCI, movement of robotic arm was controlled in three-dimensional (3D) space. In addition, muscle artifact (EMG) of "teeth clenching" condition recorded from EEG signal was detected and employed as interrupter, which can initialize the statement of SPDTBS. Real-time writing task was implemented to verify the reliability of the proposed noninvasive hybrid EEG-EMG-BCI. Eight subjects participated in this study and succeeded to manipulate a robotic arm in 3D space to write some English letters. The mean decoding accuracy of writing task was 0.93 ± 0.03. Four subjects achieved the optimal criteria of writing the word "HI" which is the minimum movement of robotic arm directions (15 steps). Other subjects had needed to take from 2 to 4 additional steps to finish the whole process. These results suggested that our proposed hybrid noninvasive EEG-EMG-BCI was robust and efficient for real-time multidimensional robotic arm control.

Citing Articles

Graph convolution network-based eeg signal analysis: a review.

Xiong H, Yan Y, Chen Y, Liu J Med Biol Eng Comput. 2025; .

PMID: 39883372 DOI: 10.1007/s11517-025-03295-0.

A Bibliometric Review of Brain-Computer Interfaces in Motor Imagery and Steady-State Visually Evoked Potentials for Applications in Rehabilitation and Robotics.

Chio N, Quiles-Cucarella E Sensors (Basel). 2025; 25(1.

PMID: 39796947 PMC: 11722989. DOI: 10.3390/s25010154.

Considerations and discussions on the clear definition and definite scope of brain-computer interfaces.

Chen Y, Wang F, Li T, Zhao L, Gong A, Nan W Front Neurosci. 2024; 18:1449208.

PMID: 39161655 PMC: 11330831. DOI: 10.3389/fnins.2024.1449208.

A Methodology for Enhancing SSVEP Features Using Adaptive Filtering Based on the Spatial Distribution of EEG Signals.

Wang S, Ji B, Shao D, Chen W, Gao K Micromachines (Basel). 2023; 14(5).

PMID: 37241600 PMC: 10223918. DOI: 10.3390/mi14050976.

A robotic arm control system with simultaneous and sequential modes combining eye-tracking with steady-state visual evoked potential in virtual reality environment.

Guo R, Lin Y, Luo X, Gao X, Zhang S Front Neurorobot. 2023; 17:1146415.

PMID: 37051328 PMC: 10083338. DOI: 10.3389/fnbot.2023.1146415.

References

Wang H, Li Y, Long J, Yu T, Gu Z . An asynchronous wheelchair control by hybrid EEG-EOG brain-computer interface. Cogn Neurodyn. 2014; 8(5):399-409. PMC: 4155067. DOI: 10.1007/s11571-014-9296-y. View

Pfurtscheller G, Lopes da Silva F . Event-related EEG/MEG synchronization and desynchronization: basic principles. Clin Neurophysiol. 1999; 110(11):1842-57. DOI: 10.1016/s1388-2457(99)00141-8. View

Bin G, Gao X, Yan Z, Hong B, Gao S . An online multi-channel SSVEP-based brain-computer interface using a canonical correlation analysis method. J Neural Eng. 2009; 6(4):046002. DOI: 10.1088/1741-2560/6/4/046002. View

Belkacem A, Saetia S, Zintus-art K, Shin D, Kambara H, Yoshimura N . Real-Time Control of a Video Game Using Eye Movements and Two Temporal EEG Sensors. Comput Intell Neurosci. 2015; 2015:653639. PMC: 4672363. DOI: 10.1155/2015/653639. View

Farwell L, Donchin E . Talking off the top of your head: toward a mental prosthesis utilizing event-related brain potentials. Electroencephalogr Clin Neurophysiol. 1988; 70(6):510-23. DOI: 10.1016/0013-4694(88)90149-6. View

Wolpaw J, Birbaumer N, McFarland D, Pfurtscheller G, Vaughan T . Brain-computer interfaces for communication and control. Clin Neurophysiol. 2002; 113(6):767-91. DOI: 10.1016/s1388-2457(02)00057-3. View

Martisius I, Damasevicius R . A Prototype SSVEP Based Real Time BCI Gaming System. Comput Intell Neurosci. 2016; 2016:3861425. PMC: 4804071. DOI: 10.1155/2016/3861425. View

Finke A, Lenhardt A, Ritter H . The MindGame: a P300-based brain-computer interface game. Neural Netw. 2009; 22(9):1329-33. DOI: 10.1016/j.neunet.2009.07.003. View

Lin Z, Zhang C, Wu W, Gao X . Frequency recognition based on canonical correlation analysis for SSVEP-based BCIs. IEEE Trans Biomed Eng. 2006; 53(12 Pt 2):2610-4. DOI: 10.1109/tbme.2006.886577. View

10.

Pfurtscheller G, Solis-Escalante T, Ortner R, Linortner P, Muller-Putz G . Self-paced operation of an SSVEP-Based orthosis with and without an imagery-based "brain switch:" a feasibility study towards a hybrid BCI. IEEE Trans Neural Syst Rehabil Eng. 2010; 18(4):409-14. DOI: 10.1109/TNSRE.2010.2040837. View

11.

Schalk G, Brunner P, Gerhardt L, Bischof H, Wolpaw J . Brain-computer interfaces (BCIs): detection instead of classification. J Neurosci Methods. 2007; 167(1):51-62. DOI: 10.1016/j.jneumeth.2007.08.010. View

12.

Birbaumer N, Weber C, Neuper C, Buch E, Haapen K, Cohen L . Physiological regulation of thinking: brain-computer interface (BCI) research. Prog Brain Res. 2006; 159:369-91. DOI: 10.1016/S0079-6123(06)59024-7. View

13.

Mason S, Bashashati A, Fatourechi M, Navarro K, Birch G . A comprehensive survey of brain interface technology designs. Ann Biomed Eng. 2006; 35(2):137-69. DOI: 10.1007/s10439-006-9170-0. View

14.

Vidal J . Toward direct brain-computer communication. Annu Rev Biophys Bioeng. 1973; 2:157-80. DOI: 10.1146/annurev.bb.02.060173.001105. View

15.

Punsawad Y, Wongsawat Y, Parnichkun M . Hybrid EEG-EOG brain-computer interface system for practical machine control. Annu Int Conf IEEE Eng Med Biol Soc. 2010; 2010:1360-3. DOI: 10.1109/IEMBS.2010.5626745. View

16.

Hochberg L, Donoghue J . Sensors for brain-computer interfaces. IEEE Eng Med Biol Mag. 2006; 25(5):32-8. DOI: 10.1109/memb.2006.1705745. View

17.

Li Y, Pan J, Wang F, Yu Z . A hybrid BCI system combining P300 and SSVEP and its application to wheelchair control. IEEE Trans Biomed Eng. 2013; 60(11):3156-66. DOI: 10.1109/TBME.2013.2270283. View

18.

Pineda J, Silverman D, Vankov A, Hestenes J . Learning to control brain rhythms: making a brain-computer interface possible. IEEE Trans Neural Syst Rehabil Eng. 2003; 11(2):181-4. DOI: 10.1109/TNSRE.2003.814445. View

19.

Pfurtscheller G, Muller-Putz G, Schlogl A, Graimann B, Scherer R, Leeb R . 15 years of BCI research at Graz University of Technology: current projects. IEEE Trans Neural Syst Rehabil Eng. 2006; 14(2):205-10. DOI: 10.1109/TNSRE.2006.875528. View

20.

Birbaumer N, Ghanayim N, Hinterberger T, Iversen I, Kotchoubey B, Kubler A . A spelling device for the paralysed. Nature. 1999; 398(6725):297-8. DOI: 10.1038/18581. View