A Spherical Phase Space Partitioning Based Symbolic Time Series Analysis (SPSP-STSA) for Emotion Recognition Using EEG Signals

Overview

Journal Front Hum Neurosci

Specialty Neurology

Date 2022 Jul 18

PMID 35845249

Authors

Hoda Tavakkoli

Ali Motie Nasrabadi

Affiliations

Soon will be listed here.

Abstract

Emotion recognition systems have been of interest to researchers for a long time. Improvement of brain-computer interface systems currently makes EEG-based emotion recognition more attractive. These systems try to develop strategies that are capable of recognizing emotions automatically. There are many approaches due to different features extractions methods for analyzing the EEG signals. Still, Since the brain is supposed to be a nonlinear dynamic system, it seems a nonlinear dynamic analysis tool may yield more convenient results. A novel approach in Symbolic Time Series Analysis (STSA) for signal phase space partitioning and symbol sequence generating is introduced in this study. Symbolic sequences have been produced by means of spherical partitioning of phase space; then, they have been compared and classified based on the maximum value of a similarity index. Obtaining the automatic independent emotion recognition EEG-based system has always been discussed because of the subject-dependent content of emotion. Here we introduce a subject-independent protocol to solve the generalization problem. To prove our method's effectiveness, we used the DEAP dataset, and we reached an accuracy of 98.44% for classifying happiness from sadness (two- emotion groups). It was 93.75% for three (happiness, sadness, and joy), 89.06% for four (happiness, sadness, joy, and terrible), and 85% for five emotional groups (happiness, sadness, joy, terrible and mellow). According to these results, it is evident that our subject-independent method is more accurate rather than many other methods in different studies. In addition, a subject-independent method has been proposed in this study, which is not considered in most of the studies in this field.

References

Alcaraz R . Symbolic Entropy Analysis and Its Applications. Entropy (Basel). 2020; 20(8). PMC: 7513094. DOI: 10.3390/e20080568. View

Lin Y, Wang C, Jung T, Wu T, Jeng S, Duann J . EEG-based emotion recognition in music listening. IEEE Trans Biomed Eng. 2010; 57(7):1798-806. DOI: 10.1109/TBME.2010.2048568. View

Reinbold P, Kageorge L, Schatz M, Grigoriev R . Robust learning from noisy, incomplete, high-dimensional experimental data via physically constrained symbolic regression. Nat Commun. 2021; 12(1):3219. PMC: 8163752. DOI: 10.1038/s41467-021-23479-0. View

Jie X, Cao R, Li L . Emotion recognition based on the sample entropy of EEG. Biomed Mater Eng. 2013; 24(1):1185-92. DOI: 10.3233/BME-130919. View

Glass L, Siegelmann H . Logical and symbolic analysis of robust biological dynamics. Curr Opin Genet Dev. 2010; 20(6):644-9. DOI: 10.1016/j.gde.2010.09.005. View

Franklin J, Ribeiro J, Fox K, Bentley K, Kleiman E, Huang X . Risk factors for suicidal thoughts and behaviors: A meta-analysis of 50 years of research. Psychol Bull. 2016; 143(2):187-232. DOI: 10.1037/bul0000084. View

Brown L, Grundlehner B, Penders J . Towards wireless emotional valence detection from EEG. Annu Int Conf IEEE Eng Med Biol Soc. 2012; 2011:2188-91. DOI: 10.1109/IEMBS.2011.6090412. View

Khezri M, Firoozabadi M, Sharafat A . Reliable emotion recognition system based on dynamic adaptive fusion of forehead biopotentials and physiological signals. Comput Methods Programs Biomed. 2015; 122(2):149-64. DOI: 10.1016/j.cmpb.2015.07.006. View

Flynn M, Effraimidis D, Angelopoulou A, Kapetanios E, Williams D, Hemanth J . Assessing the Effectiveness of Automated Emotion Recognition in Adults and Children for Clinical Investigation. Front Hum Neurosci. 2020; 14:70. PMC: 7156005. DOI: 10.3389/fnhum.2020.00070. View

10.

Chai X, Wang Q, Zhao Y, Liu X, Bai O, Li Y . Unsupervised domain adaptation techniques based on auto-encoder for non-stationary EEG-based emotion recognition. Comput Biol Med. 2016; 79:205-214. DOI: 10.1016/j.compbiomed.2016.10.019. View

11.

Stam C . Nonlinear dynamical analysis of EEG and MEG: review of an emerging field. Clin Neurophysiol. 2005; 116(10):2266-301. DOI: 10.1016/j.clinph.2005.06.011. View

12.

Petrantonakis P, Hadjileontiadis L . A novel emotion elicitation index using frontal brain asymmetry for enhanced EEG-based emotion recognition. IEEE Trans Inf Technol Biomed. 2011; 15(5):737-46. DOI: 10.1109/TITB.2011.2157933. View

13.

Proverbio A, Camporeale E, Brusa A . Multimodal Recognition of Emotions in Music and Facial Expressions. Front Hum Neurosci. 2020; 14:32. PMC: 7027335. DOI: 10.3389/fnhum.2020.00032. View

14.

Ebrahimzadeh E, Shams M, Seraji M, Sadjadi S, Rajabion L, Soltanian-Zadeh H . Localizing Epileptic Foci Using Simultaneous EEG-fMRI Recording: Template Component Cross-Correlation. Front Neurol. 2021; 12:695997. PMC: 8634837. DOI: 10.3389/fneur.2021.695997. View

15.

Taran S, Bajaj V . Emotion recognition from single-channel EEG signals using a two-stage correlation and instantaneous frequency-based filtering method. Comput Methods Programs Biomed. 2019; 173:157-165. DOI: 10.1016/j.cmpb.2019.03.015. View

16.

Lehnertz K, Dickten H . Assessing directionality and strength of coupling through symbolic analysis: an application to epilepsy patients. Philos Trans A Math Phys Eng Sci. 2014; 373(2034). PMC: 4281866. DOI: 10.1098/rsta.2014.0094. View

17.

Ebrahimzadeh E, Shams M, Fayaz F, Rajabion L, Mirbagheri M, Nadjar Araabi B . Quantitative determination of concordance in localizing epileptic focus by component-based EEG-fMRI. Comput Methods Programs Biomed. 2019; 177:231-241. DOI: 10.1016/j.cmpb.2019.06.003. View

18.

Candra H, Yuwono M, Handojoseno A, Chai R, Su S, Nguyen H . Recognizing emotions from EEG subbands using wavelet analysis. Annu Int Conf IEEE Eng Med Biol Soc. 2016; 2015:6030-3. DOI: 10.1109/EMBC.2015.7319766. View

19.

Ioannou S, Raouzaiou A, Tzouvaras V, Mailis T, Karpouzis K, Kollias S . Emotion recognition through facial expression analysis based on a neurofuzzy network. Neural Netw. 2005; 18(4):423-35. DOI: 10.1016/j.neunet.2005.03.004. View

20.

Raeisi K, Mohebbi M, Khazaei M, Seraji M, Yoonessi A . Phase-synchrony evaluation of EEG signals for Multiple Sclerosis diagnosis based on bivariate empirical mode decomposition during a visual task. Comput Biol Med. 2020; 117:103596. DOI: 10.1016/j.compbiomed.2019.103596. View