Influence of Multimodal Emotional Stimulations on Brain Activity: An Electroencephalographic Study

Overview

Journal Sensors (Basel)

Publisher MDPI

Specialty Biotechnology

Date 2023 Jul 11

PMID 37430714

Authors

Chenguang Gao

Hirotaka Uchitomi

Yoshihiro Miyake

Affiliations

Soon will be listed here.

Abstract

This study aimed to reveal the influence of emotional valence and sensory modality on neural activity in response to multimodal emotional stimuli using scalp EEG. In this study, 20 healthy participants completed the emotional multimodal stimulation experiment for three stimulus modalities (audio, visual, and audio-visual), all of which are from the same video source with two emotional components (pleasure or unpleasure), and EEG data were collected using six experimental conditions and one resting state. We analyzed power spectral density (PSD) and event-related potential (ERP) components in response to multimodal emotional stimuli, for spectral and temporal analysis. PSD results showed that the single modality (audio only/visual only) emotional stimulation PSD differed from multi-modality (audio-visual) in a wide brain and band range due to the changes in modality and not from the changes in emotional degree. The most pronounced N200-to-P300 potential shifts occurred in monomodal rather than multimodal emotional stimulations. This study suggests that emotional saliency and sensory processing efficiency perform a significant role in shaping neural activity during multimodal emotional stimulation, with the sensory modality being more influential in PSD. These findings contribute to our understanding of the neural mechanisms involved in multimodal emotional stimulation.

Citing Articles

Cross-Sensory EEG Emotion Recognition with Filter Bank Riemannian Feature and Adversarial Domain Adaptation.

Gao C, Uchitomi H, Miyake Y Brain Sci. 2023; 13(9).

PMID: 37759927 PMC: 10526196. DOI: 10.3390/brainsci13091326.

References

Yu W, Wu X, Chen Y, Liang Z, Jiang J, Misrani A . Pelvic Pain Alters Functional Connectivity Between Anterior Cingulate Cortex and Hippocampus in Both Humans and a Rat Model. Front Syst Neurosci. 2021; 15:642349. PMC: 8210850. DOI: 10.3389/fnsys.2021.642349. View

Gramfort A, Luessi M, Larson E, Engemann D, Strohmeier D, Brodbeck C . MNE software for processing MEG and EEG data. Neuroimage. 2013; 86:446-60. PMC: 3930851. DOI: 10.1016/j.neuroimage.2013.10.027. View

Shu L, Xie J, Yang M, Li Z, Li Z, Liao D . A Review of Emotion Recognition Using Physiological Signals. Sensors (Basel). 2018; 18(7). PMC: 6069143. DOI: 10.3390/s18072074. View

Kemp A, Hopkinson P, Hermens D, Rowe D, Sumich A, Clark C . Fronto-temporal alterations within the first 200 ms during an attentional task distinguish major depression, non-clinical participants with depressed mood and healthy controls: a potential biomarker?. Hum Brain Mapp. 2008; 30(2):602-14. PMC: 6870851. DOI: 10.1002/hbm.20528. View

Cantero J, Atienza M, Salas R, Dominguez-Marin E . Effects of prolonged waking-auditory stimulation on electroencephalogram synchronization and cortical coherence during subsequent slow-wave sleep. J Neurosci. 2002; 22(11):4702-8. PMC: 6758780. DOI: 20026463. View

Rahman M, Sarkar A, Hossain M, Hossain M, Islam M, Hossain M . Recognition of human emotions using EEG signals: A review. Comput Biol Med. 2021; 136:104696. DOI: 10.1016/j.compbiomed.2021.104696. View

Stancin I, Cifrek M, Jovic A . A Review of EEG Signal Features and their Application in Driver Drowsiness Detection Systems. Sensors (Basel). 2021; 21(11). PMC: 8198610. DOI: 10.3390/s21113786. View

Dmochowski J, Sajda P, Dias J, Parra L . Correlated components of ongoing EEG point to emotionally laden attention - a possible marker of engagement?. Front Hum Neurosci. 2012; 6:112. PMC: 3353265. DOI: 10.3389/fnhum.2012.00112. View

Costa T, Rognoni E, Galati D . EEG phase synchronization during emotional response to positive and negative film stimuli. Neurosci Lett. 2006; 406(3):159-64. DOI: 10.1016/j.neulet.2006.06.039. View

10.

Lagopoulos J, Xu J, Rasmussen I, Vik A, Malhi G, Eliassen C . Increased theta and alpha EEG activity during nondirective meditation. J Altern Complement Med. 2009; 15(11):1187-92. DOI: 10.1089/acm.2009.0113. View

11.

Lucas N, Vuilleumier P . Effects of emotional and non-emotional cues on visual search in neglect patients: evidence for distinct sources of attentional guidance. Neuropsychologia. 2008; 46(5):1401-14. DOI: 10.1016/j.neuropsychologia.2007.12.027. View

12.

Grasso P, Pietrelli M, Zanon M, Ladavas E, Bertini C . Alpha oscillations reveal implicit visual processing of motion in hemianopia. Cortex. 2018; 122:81-96. DOI: 10.1016/j.cortex.2018.08.009. View

13.

Izhar L, Babiker A, Rizki E, Lu C, Abdul Rahman M . Emotion Self-Regulation in Neurotic Students: A Pilot Mindfulness-Based Intervention to Assess Its Effectiveness through Brain Signals and Behavioral Data. Sensors (Basel). 2022; 22(7). PMC: 9002961. DOI: 10.3390/s22072703. View

14.

Patel S, Azzam P . Characterization of N200 and P300: selected studies of the Event-Related Potential. Int J Med Sci. 2005; 2(4):147-54. PMC: 1252727. DOI: 10.7150/ijms.2.147. View

15.

Balconi M, Vanutelli M . Vocal and visual stimulation, congruence and lateralization affect brain oscillations in interspecies emotional positive and negative interactions. Soc Neurosci. 2015; 11(3):297-310. DOI: 10.1080/17470919.2015.1081400. View

16.

Mulders D, de Bodt C, Lejeune N, Courtin A, Liberati G, Verleysen M . Dynamics of the perception and EEG signals triggered by tonic warm and cool stimulation. PLoS One. 2020; 15(4):e0231698. PMC: 7179871. DOI: 10.1371/journal.pone.0231698. View

17.

Delorme A, Makeig S . EEGLAB: an open source toolbox for analysis of single-trial EEG dynamics including independent component analysis. J Neurosci Methods. 2004; 134(1):9-21. DOI: 10.1016/j.jneumeth.2003.10.009. View

18.

Chaplin T, Rosa M, Lui L . Auditory and Visual Motion Processing and Integration in the Primate Cerebral Cortex. Front Neural Circuits. 2018; 12:93. PMC: 6212655. DOI: 10.3389/fncir.2018.00093. View

19.

Jaaskelainen I, Sams M, Glerean E, Ahveninen J . Movies and narratives as naturalistic stimuli in neuroimaging. Neuroimage. 2020; 224:117445. PMC: 7805386. DOI: 10.1016/j.neuroimage.2020.117445. View

20.

Sonkusare S, Nguyen V, Moran R, van der Meer J, Ren Y, Koussis N . Intracranial-EEG evidence for medial temporal pole driving amygdala activity induced by multi-modal emotional stimuli. Cortex. 2020; 130:32-48. DOI: 10.1016/j.cortex.2020.05.018. View