A Low-cost EEG System-based Hybrid Brain-computer Interface for Humanoid Robot Navigation and Recognition

Overview

Journal PLoS One

Specialties General Medicine
Science

Date 2013 Sep 12

PMID 24023953

Citations 25

Authors

Bongjae Choi

Sungho Jo

Affiliations

Soon will be listed here.

Abstract

This paper describes a hybrid brain-computer interface (BCI) technique that combines the P300 potential, the steady state visually evoked potential (SSVEP), and event related de-synchronization (ERD) to solve a complicated multi-task problem consisting of humanoid robot navigation and control along with object recognition using a low-cost BCI system. Our approach enables subjects to control the navigation and exploration of a humanoid robot and recognize a desired object among candidates. This study aims to demonstrate the possibility of a hybrid BCI based on a low-cost system for a realistic and complex task. It also shows that the use of a simple image processing technique, combined with BCI, can further aid in making these complex tasks simpler. An experimental scenario is proposed in which a subject remotely controls a humanoid robot in a properly sized maze. The subject sees what the surrogate robot sees through visual feedback and can navigate the surrogate robot. While navigating, the robot encounters objects located in the maze. It then recognizes if the encountered object is of interest to the subject. The subject communicates with the robot through SSVEP and ERD-based BCIs to navigate and explore with the robot, and P300-based BCI to allow the surrogate robot recognize their favorites. Using several evaluation metrics, the performances of five subjects navigating the robot were quite comparable to manual keyboard control. During object recognition mode, favorite objects were successfully selected from two to four choices. Subjects conducted humanoid navigation and recognition tasks as if they embodied the robot. Analysis of the data supports the potential usefulness of the proposed hybrid BCI system for extended applications. This work presents an important implication for the future work that a hybridization of simple BCI protocols provide extended controllability to carry out complicated tasks even with a low-cost system.

Citing Articles

Utility of Electroencephalograms for Enhancing Clinical Care and Rehabilitation of Children with Acquired Brain Injury.

Politi K, Weiss P, Givony K, Zion Golumbic E Int J Environ Res Public Health. 2024; 21(11).

PMID: 39595733 PMC: 11593451. DOI: 10.3390/ijerph21111466.

A Brain-Controlled Quadruped Robot: A Proof-of-Concept Demonstration.

Kosmyna N, Hauptmann E, Hmaidan Y Sensors (Basel). 2024; 24(1).

PMID: 38202942 PMC: 10780665. DOI: 10.3390/s24010080.

Sparse Logistic Regression-Based EEG Channel Optimization Algorithm for Improved Universality across Participants.

Shi Y, Li Y, Koike Y Bioengineering (Basel). 2023; 10(6).

PMID: 37370595 PMC: 10295307. DOI: 10.3390/bioengineering10060664.

MA-CharNet: Multi-angle fusion character recognition network.

Wang Q, Liu J, Zhu Z, Deng C PLoS One. 2022; 17(8):e0272601.

PMID: 36037174 PMC: 9423680. DOI: 10.1371/journal.pone.0272601.

Progress in Brain Computer Interface: Challenges and Opportunities.

Saha S, Mamun K, Ahmed K, Mostafa R, Naik G, Darvishi S Front Syst Neurosci. 2021; 15:578875.

PMID: 33716680 PMC: 7947348. DOI: 10.3389/fnsys.2021.578875.

References

Allison B, Brunner C, Altstatter C, Wagner I, Grissmann S, Neuper C . A hybrid ERD/SSVEP BCI for continuous simultaneous two dimensional cursor control. J Neurosci Methods. 2012; 209(2):299-307. DOI: 10.1016/j.jneumeth.2012.06.022. View

Pfurtscheller G, Brunner C, Schlogl A, Lopes da Silva F . Mu rhythm (de)synchronization and EEG single-trial classification of different motor imagery tasks. Neuroimage. 2006; 31(1):153-9. DOI: 10.1016/j.neuroimage.2005.12.003. View

Fazli S, Mehnert J, Steinbrink J, Curio G, Villringer A, Muller K . Enhanced performance by a hybrid NIRS-EEG brain computer interface. Neuroimage. 2011; 59(1):519-29. DOI: 10.1016/j.neuroimage.2011.07.084. View

Bobrov P, Frolov A, Cantor C, Fedulova I, Bakhnyan M, Zhavoronkov A . Brain-computer interface based on generation of visual images. PLoS One. 2011; 6(6):e20674. PMC: 3112189. DOI: 10.1371/journal.pone.0020674. View

Horki P, Solis-Escalante T, Neuper C, Muller-Putz G . Combined motor imagery and SSVEP based BCI control of a 2 DoF artificial upper limb. Med Biol Eng Comput. 2011; 49(5):567-77. DOI: 10.1007/s11517-011-0750-2. View

Bell C, Shenoy P, Chalodhorn R, Rao R . Control of a humanoid robot by a noninvasive brain-computer interface in humans. J Neural Eng. 2008; 5(2):214-20. DOI: 10.1088/1741-2560/5/2/012. View

Pfurtscheller G, Solis-Escalante T, Ortner R, Linortner P, Muller-Putz G . Self-paced operation of an SSVEP-Based orthosis with and without an imagery-based "brain switch:" a feasibility study towards a hybrid BCI. IEEE Trans Neural Syst Rehabil Eng. 2010; 18(4):409-14. DOI: 10.1109/TNSRE.2010.2040837. View

Turnip A, Hong K, Jeong M . Real-time feature extraction of P300 component using adaptive nonlinear principal component analysis. Biomed Eng Online. 2011; 10:83. PMC: 3749271. DOI: 10.1186/1475-925X-10-83. View

Rivet B, Souloumiac A, Attina V, Gibert G . xDAWN algorithm to enhance evoked potentials: application to brain-computer interface. IEEE Trans Biomed Eng. 2009; 56(8):2035-43. DOI: 10.1109/TBME.2009.2012869. View

10.

Millan J, Rupp R, Muller-Putz G, Murray-Smith R, Giugliemma C, Tangermann M . Combining Brain-Computer Interfaces and Assistive Technologies: State-of-the-Art and Challenges. Front Neurosci. 2010; 4. PMC: 2944670. DOI: 10.3389/fnins.2010.00161. View

11.

Bin G, Gao X, Yan Z, Hong B, Gao S . An online multi-channel SSVEP-based brain-computer interface using a canonical correlation analysis method. J Neural Eng. 2009; 6(4):046002. DOI: 10.1088/1741-2560/6/4/046002. View

12.

Pfurtscheller G, Neuper C, Guger C, Harkam W, Ramoser H, Schlogl A . Current trends in Graz Brain-Computer Interface (BCI) research. IEEE Trans Rehabil Eng. 2000; 8(2):216-9. DOI: 10.1109/86.847821. View

13.

Li Y, Long J, Yu T, Yu Z, Wang C, Zhang H . An EEG-based BCI system for 2-D cursor control by combining Mu/Beta rhythm and P300 potential. IEEE Trans Biomed Eng. 2010; 57(10):2495-505. DOI: 10.1109/TBME.2010.2055564. View

14.

Lotte F, Congedo M, Lecuyer A, Lamarche F, Arnaldi B . A review of classification algorithms for EEG-based brain-computer interfaces. J Neural Eng. 2007; 4(2):R1-R13. DOI: 10.1088/1741-2560/4/2/R01. View

15.

McFarland D, Wolpaw J . Brain-Computer Interfaces for Communication and Control. Commun ACM. 2011; 54(5):60-66. PMC: 3188401. DOI: 10.1145/1941487.1941506. View

16.

Allison B, Leeb R, Brunner C, Muller-Putz G, Bauernfeind G, Kelly J . Toward smarter BCIs: extending BCIs through hybridization and intelligent control. J Neural Eng. 2011; 9(1):013001. DOI: 10.1088/1741-2560/9/1/013001. View

17.

Leeb R, Sagha H, Chavarriaga R, Millan J . A hybrid brain-computer interface based on the fusion of electroencephalographic and electromyographic activities. J Neural Eng. 2011; 8(2):025011. DOI: 10.1088/1741-2560/8/2/025011. View

18.

Pfurtscheller G, Allison B, Brunner C, Bauernfeind G, Solis-Escalante T, Scherer R . The hybrid BCI. Front Neurosci. 2010; 4:30. PMC: 2891647. DOI: 10.3389/fnpro.2010.00003. View

19.

Long J, Li Y, Wang H, Yu T, Pan J, Li F . A hybrid brain computer interface to control the direction and speed of a simulated or real wheelchair. IEEE Trans Neural Syst Rehabil Eng. 2012; 20(5):720-9. DOI: 10.1109/TNSRE.2012.2197221. View

20.

Gao X, Xu D, Cheng M, Gao S . A BCI-based environmental controller for the motion-disabled. IEEE Trans Neural Syst Rehabil Eng. 2003; 11(2):137-40. DOI: 10.1109/TNSRE.2003.814449. View