Brain-machine Interface Via Real-time FMRI: Preliminary Study on Thought-controlled Robotic Arm

Overview

Journal Neurosci Lett

Specialty Neurology

Date 2008 Nov 26

PMID 19026717

Citations 34

Authors

Jong-Hwan Lee

Jeongwon Ryu

Ferenc A Jolesz

Zang-Hee Cho

Seung-Schik Yoo

Affiliations

Soon will be listed here.

Abstract

Real-time functional MRI (rtfMRI) has been used as a basis for brain-computer interface (BCI) due to its ability to characterize region-specific brain activity in real-time. As an extension of BCI, we present an rtfMRI-based brain-machine interface (BMI) whereby 2-dimensional movement of a robotic arm was controlled by the regulation (and concurrent detection) of regional cortical activations in the primary motor areas. To do so, the subjects were engaged in the right- and/or left-hand motor imagery tasks. The blood oxygenation level dependent (BOLD) signal originating from the corresponding hand motor areas was then translated into horizontal or vertical robotic arm movement. The movement was broadcasted visually back to the subject as a feedback. We demonstrated that real-time control of the robotic arm only through the subjects' thought processes was possible using the rtfMRI-based BMI trials.

Citing Articles

A Bibliometric Review of Brain-Computer Interfaces in Motor Imagery and Steady-State Visually Evoked Potentials for Applications in Rehabilitation and Robotics.

Chio N, Quiles-Cucarella E Sensors (Basel). 2025; 25(1.

PMID: 39796947 PMC: 11722989. DOI: 10.3390/s25010154.

Regulation of craving for real-time fMRI neurofeedback based on individual classification.

Kim D, Lisinski J, Caton M, Casas B, LaConte S, Chiu P Philos Trans R Soc Lond B Biol Sci. 2024; 379(1915):20230094.

PMID: 39428878 PMC: 11491846. DOI: 10.1098/rstb.2023.0094.

Impact of trivalent Yttrium on the structural and optical properties of CaAlO: New frontier in supercapacitor positive electrode.

Nkuna E, Mhlongo M, Dlamini C, Melato L, Bele A, Maphiri V Heliyon. 2024; 10(12):e33274.

PMID: 39027439 PMC: 11254605. DOI: 10.1016/j.heliyon.2024.e33274.

The Emergence of Functional Ultrasound for Noninvasive Brain-Computer Interface.

Zheng H, Niu L, Qiu W, Liang D, Long X, Li G Research (Wash D C). 2023; 6:0200.

PMID: 37588619 PMC: 10427153. DOI: 10.34133/research.0200.

Magnetic resonance imaging at 9.4 T: the Maastricht journey.

Ivanov D, De Martino F, Formisano E, Fritz F, Goebel R, Huber L MAGMA. 2023; 36(2):159-173.

PMID: 37081247 PMC: 10140139. DOI: 10.1007/s10334-023-01080-4.

References

Hornby T, Campbell D, Kahn J, Demott T, Moore J, Roth H . Enhanced gait-related improvements after therapist- versus robotic-assisted locomotor training in subjects with chronic stroke: a randomized controlled study. Stroke. 2008; 39(6):1786-92. DOI: 10.1161/STROKEAHA.107.504779. View

Hochberg L, Serruya M, Friehs G, Mukand J, Saleh M, Caplan A . Neuronal ensemble control of prosthetic devices by a human with tetraplegia. Nature. 2006; 442(7099):164-71. DOI: 10.1038/nature04970. View

Manning L . Do some neurological conditions induce brain plasticity processes?. Behav Brain Res. 2008; 192(1):143-8. DOI: 10.1016/j.bbr.2008.04.001. View

Tzourio-Mazoyer N, Landeau B, Papathanassiou D, Crivello F, Etard O, Delcroix N . Automated anatomical labeling of activations in SPM using a macroscopic anatomical parcellation of the MNI MRI single-subject brain. Neuroimage. 2002; 15(1):273-89. DOI: 10.1006/nimg.2001.0978. View

Mantini D, Perrucci M, Cugini S, Ferretti A, Romani G, Del Gratta C . Complete artifact removal for EEG recorded during continuous fMRI using independent component analysis. Neuroimage. 2006; 34(2):598-607. DOI: 10.1016/j.neuroimage.2006.09.037. View

Smith A, Lewis B, Ruttimann U, Ye F, Sinnwell T, Yang Y . Investigation of low frequency drift in fMRI signal. Neuroimage. 1999; 9(5):526-33. DOI: 10.1006/nimg.1999.0435. View

Zaitsev M, Dold C, Sakas G, Hennig J, Speck O . Magnetic resonance imaging of freely moving objects: prospective real-time motion correction using an external optical motion tracking system. Neuroimage. 2006; 31(3):1038-50. DOI: 10.1016/j.neuroimage.2006.01.039. View

Posse S, Fitzgerald D, Gao K, Habel U, Rosenberg D, Moore G . Real-time fMRI of temporolimbic regions detects amygdala activation during single-trial self-induced sadness. Neuroimage. 2003; 18(3):760-8. DOI: 10.1016/s1053-8119(03)00004-1. View

Birbaumer N, Cohen L . Brain-computer interfaces: communication and restoration of movement in paralysis. J Physiol. 2007; 579(Pt 3):621-36. PMC: 2151357. DOI: 10.1113/jphysiol.2006.125633. View

10.

Foerster B, Tomasi D, Caparelli E . Magnetic field shift due to mechanical vibration in functional magnetic resonance imaging. Magn Reson Med. 2005; 54(5):1261-7. PMC: 2408718. DOI: 10.1002/mrm.20695. View

11.

Weiskopf N, Veit R, Erb M, Mathiak K, Grodd W, Goebel R . Physiological self-regulation of regional brain activity using real-time functional magnetic resonance imaging (fMRI): methodology and exemplary data. Neuroimage. 2003; 19(3):577-86. DOI: 10.1016/s1053-8119(03)00145-9. View

12.

Yoo S, Lee J, OLeary H, Panych L, Jolesz F . Neurofeedback fMRI-mediated learning and consolidation of regional brain activation during motor imagery. Int J Imaging Syst Technol. 2009; 18(1):69-78. PMC: 2630170. DOI: 10.1002/ima.20139. View

13.

Yoo S, Fairneny T, Chen N, Choo S, Panych L, Park H . Brain-computer interface using fMRI: spatial navigation by thoughts. Neuroreport. 2004; 15(10):1591-5. DOI: 10.1097/01.wnr.0000133296.39160.fe. View

14.

Yoo S, Lee J, OLeary H, Lee V, Choo S, Jolesz F . Functional magnetic resonance imaging-mediated learning of increased activity in auditory areas. Neuroreport. 2007; 18(18):1915-20. DOI: 10.1097/WNR.0b013e3282f202ac. View

15.

Yoo S, OLeary H, Lee J, Chen N, Panych L, Jolesz F . Reproducibility of trial-based functional MRI on motor imagery. Int J Neurosci. 2007; 117(2):215-27. DOI: 10.1080/00207450600582546. View

16.

Friston K, Holmes A, Worsley K . How many subjects constitute a study?. Neuroimage. 1999; 10(1):1-5. DOI: 10.1006/nimg.1999.0439. View

17.

Christopher deCharms R, Christoff K, Glover G, Pauly J, Whitfield S, Gabrieli J . Learned regulation of spatially localized brain activation using real-time fMRI. Neuroimage. 2004; 21(1):436-43. DOI: 10.1016/j.neuroimage.2003.08.041. View

18.

Glickman M, van Dyk D . Basic Bayesian methods. Methods Mol Biol. 2008; 404:319-38. DOI: 10.1007/978-1-59745-530-5_16. View

19.

Hornyak T . Thinking of child's play. Sci Am. 2006; 295(3):30. DOI: 10.1038/scientificamerican0906-30. View

20.

Taylor D, Helms Tillery S, Schwartz A . Direct cortical control of 3D neuroprosthetic devices. Science. 2002; 296(5574):1829-32. DOI: 10.1126/science.1070291. View