Utilizing Sensory Prediction Errors for Movement Intention Decoding: A New Methodology
Authors
Affiliations
We propose a new methodology for decoding movement intentions of humans. This methodology is motivated by the well-documented ability of the brain to predict sensory outcomes of self-generated and imagined actions using so-called forward models. We propose to subliminally stimulate the sensory modality corresponding to a user's intended movement, and decode a user's movement intention from his electroencephalography (EEG), by decoding for prediction errors-whether the sensory prediction corresponding to a user's intended movement matches the subliminal sensory stimulation we induce. We tested our proposal in a binary wheelchair turning task in which users thought of turning their wheelchair either left or right. We stimulated their vestibular system subliminally, toward either the left or the right direction, using a galvanic vestibular stimulator and show that the decoding for prediction errors from the EEG can radically improve movement intention decoding performance. We observed an 87.2% median single-trial decoding accuracy across tested participants, with zero user training, within 96 ms of the stimulation, and with no additional cognitive load on the users because the stimulation was subliminal.
Understanding common human driving semantics for autonomous vehicles.
Xia Y, Geng M, Chen Y, Sun S, Liao C, Zhu Z Patterns (N Y). 2023; 4(7):100730.
PMID: 37521046 PMC: 10382946. DOI: 10.1016/j.patter.2023.100730.
Shi Y, Li Y, Koike Y Bioengineering (Basel). 2023; 10(6).
PMID: 37370595 PMC: 10295307. DOI: 10.3390/bioengineering10060664.
A CW-CNN regression model-based real-time system for virtual hand control.
Qin Z, He Z, Li Y, Saetia S, Koike Y Front Neurorobot. 2023; 16:1072365.
PMID: 36620487 PMC: 9812573. DOI: 10.3389/fnbot.2022.1072365.
Non-von Neumann multi-input spike signal processing enabled by an artificial synaptic multiplexer.
Ho D, Roe D, Choi Y, Kim S, Choi Y, Kim D Sci Adv. 2022; 8(25):eabn1838.
PMID: 35731885 PMC: 9217087. DOI: 10.1126/sciadv.abn1838.
Yoshimura N, Umetsu K, Tonin A, Maruyama Y, Harada K, Rana A Cereb Cortex Commun. 2021; 2(3):tgab046.
PMID: 34447933 PMC: 8382900. DOI: 10.1093/texcom/tgab046.