Parietal Neural Prosthetic Control of a Computer Cursor in a Graphical-user-interface Task

Overview

Journal J Neural Eng

Specialties Biomedical Engineering
Neurology

Date 2014 Nov 15

PMID 25394419

Citations 5

Authors

Boris Revechkis

Tyson N S Aflalo

Spencer Kellis

Nader Pouratian

Richard A Andersen

Affiliations

Soon will be listed here.

Abstract

Objective: To date, the majority of Brain-Machine Interfaces have been used to perform simple tasks with sequences of individual targets in otherwise blank environments. In this study we developed a more practical and clinically relevant task that approximated modern computers and graphical user interfaces (GUIs). This task could be problematic given the known sensitivity of areas typically used for BMIs to visual stimuli, eye movements, decision-making, and attentional control. Consequently, we sought to assess the effect of a complex, GUI-like task on the quality of neural decoding.

Approach: A male rhesus macaque monkey was implanted with two 96-channel electrode arrays in area 5d of the superior parietal lobule. The animal was trained to perform a GUI-like 'Face in a Crowd' task on a computer screen that required selecting one cued, icon-like, face image from a group of alternatives (the 'Crowd') using a neurally controlled cursor. We assessed whether the crowd affected decodes of intended cursor movements by comparing it to a 'Crowd Off' condition in which only the matching target appeared without alternatives. We also examined if training a neural decoder with the Crowd On rather than Off had any effect on subsequent decode quality.

Main Results: Despite the additional demands of working with the Crowd On, the animal was able to robustly perform the task under Brain Control. The presence of the crowd did not itself affect decode quality. Training the decoder with the Crowd On relative to Off had no negative influence on subsequent decoding performance. Additionally, the subject was able to gaze around freely without influencing cursor position.

Significance: Our results demonstrate that area 5d recordings can be used for decoding in a complex, GUI-like task with free gaze. Thus, this area is a promising source of signals for neural prosthetics that utilize computing devices with GUI interfaces, e.g. personal computers, mobile devices, and tablet computers.

Citing Articles

Morphological patterns and spatial probability maps of the superior parietal sulcus in the human brain.

Drudik K, Zlatkina V, Petrides M Cereb Cortex. 2022; 33(4):1230-1245.

PMID: 35388402 PMC: 9930623. DOI: 10.1093/cercor/bhac132.

Viral-Mediated Optogenetic Stimulation of Peripheral Motor Nerves in Non-human Primates.

Williams J, Watson A, Vazquez A, Schwartz A Front Neurosci. 2019; 13:759.

PMID: 31417342 PMC: 6684788. DOI: 10.3389/fnins.2019.00759.

Emerging ideas and tools to study the emergent properties of the cortical neural circuits for voluntary motor control in non-human primates.

Kalaska J F1000Res. 2019; 8.

PMID: 31275561 PMC: 6544130. DOI: 10.12688/f1000research.17161.1.

Long-term stability of neural signals from microwire arrays implanted in common marmoset motor cortex and striatum.

Debnath S, Prins N, Pohlmeyer E, Mylavarapu R, Geng S, Sanchez J Biomed Phys Eng Express. 2019; 4(5).

PMID: 31011432 PMC: 6474681. DOI: 10.1088/2057-1976/aada67.

Toward more versatile and intuitive cortical brain-machine interfaces.

Andersen R, Kellis S, Klaes C, Aflalo T Curr Biol. 2014; 24(18):R885-R897.

PMID: 25247368 PMC: 4410026. DOI: 10.1016/j.cub.2014.07.068.

References

Hwang E, Andersen R . The utility of multichannel local field potentials for brain-machine interfaces. J Neural Eng. 2013; 10(4):046005. PMC: 3731147. DOI: 10.1088/1741-2560/10/4/046005. View

Buneo C, Andersen R . The posterior parietal cortex: sensorimotor interface for the planning and online control of visually guided movements. Neuropsychologia. 2005; 44(13):2594-606. DOI: 10.1016/j.neuropsychologia.2005.10.011. View

Pesaran B, Musallam S, Andersen R . Cognitive neural prosthetics. Curr Biol. 2006; 16(3):R77-80. DOI: 10.1016/j.cub.2006.01.043. View

ODoherty J, Lebedev M, Ifft P, Zhuang K, Shokur S, Bleuler H . Active tactile exploration using a brain-machine-brain interface. Nature. 2011; 479(7372):228-31. PMC: 3236080. DOI: 10.1038/nature10489. View

Ifft P, Shokur S, Li Z, Lebedev M, Nicolelis M . A brain-machine interface enables bimanual arm movements in monkeys. Sci Transl Med. 2013; 5(210):210ra154. PMC: 3967722. DOI: 10.1126/scitranslmed.3006159. View

Franke F, Jackel D, Dragas J, Muller J, Radivojevic M, Bakkum D . High-density microelectrode array recordings and real-time spike sorting for closed-loop experiments: an emerging technology to study neural plasticity. Front Neural Circuits. 2012; 6:105. PMC: 3526803. DOI: 10.3389/fncir.2012.00105. View

Mulliken G, Musallam S, Andersen R . Decoding trajectories from posterior parietal cortex ensembles. J Neurosci. 2008; 28(48):12913-26. PMC: 2728059. DOI: 10.1523/JNEUROSCI.1463-08.2008. View

Bremner L, Andersen R . Coding of the reach vector in parietal area 5d. Neuron. 2012; 75(2):342-51. PMC: 3408621. DOI: 10.1016/j.neuron.2012.03.041. View

Graziano M, Cooke D, Taylor C . Coding the location of the arm by sight. Science. 2000; 290(5497):1782-6. DOI: 10.1126/science.290.5497.1782. View

10.

Velliste M, Perel S, Spalding M, Whitford A, Schwartz A . Cortical control of a prosthetic arm for self-feeding. Nature. 2008; 453(7198):1098-101. DOI: 10.1038/nature06996. View

11.

Pesaran B, Nelson M, Andersen R . Free choice activates a decision circuit between frontal and parietal cortex. Nature. 2008; 453(7193):406-9. PMC: 2728060. DOI: 10.1038/nature06849. View

12.

Peirce J . PsychoPy--Psychophysics software in Python. J Neurosci Methods. 2007; 162(1-2):8-13. PMC: 2018741. DOI: 10.1016/j.jneumeth.2006.11.017. View

13.

Pesaran B, Nelson M, Andersen R . A relative position code for saccades in dorsal premotor cortex. J Neurosci. 2010; 30(19):6527-37. PMC: 2887302. DOI: 10.1523/JNEUROSCI.1625-09.2010. View

14.

Crammond D, Kalaska J . Neuronal activity in primate parietal cortex area 5 varies with intended movement direction during an instructed-delay period. Exp Brain Res. 1989; 76(2):458-62. DOI: 10.1007/BF00247902. View

15.

Soto D, Heinke D, Humphreys G, Blanco M . Early, involuntary top-down guidance of attention from working memory. J Exp Psychol Hum Percept Perform. 2005; 31(2):248-61. DOI: 10.1037/0096-1523.31.2.248. View

16.

Fraser G, Chase S, Whitford A, Schwartz A . Control of a brain-computer interface without spike sorting. J Neural Eng. 2009; 6(5):055004. DOI: 10.1088/1741-2560/6/5/055004. View

17.

Louie K, Grattan L, Glimcher P . Reward value-based gain control: divisive normalization in parietal cortex. J Neurosci. 2011; 31(29):10627-39. PMC: 3285508. DOI: 10.1523/JNEUROSCI.1237-11.2011. View

18.

Gilja V, Nuyujukian P, Chestek C, Cunningham J, Yu B, Fan J . A high-performance neural prosthesis enabled by control algorithm design. Nat Neurosci. 2012; 15(12):1752-7. PMC: 3638087. DOI: 10.1038/nn.3265. View

19.

Rao N, Donoghue J . Cue to action processing in motor cortex populations. J Neurophysiol. 2013; 111(2):441-53. PMC: 3921381. DOI: 10.1152/jn.00274.2013. View

20.

Hauschild M, Mulliken G, Fineman I, Loeb G, Andersen R . Cognitive signals for brain-machine interfaces in posterior parietal cortex include continuous 3D trajectory commands. Proc Natl Acad Sci U S A. 2012; 109(42):17075-80. PMC: 3479517. DOI: 10.1073/pnas.1215092109. View