北京生物医学工程

基于虚拟现实的不同情绪视频下的脑电谱特性

EEG spectralcharacteristicsunder virtual reality based onemotional videos

作者：李海宝李颖洁华旻磊田丰杨帮华

单位：上海大学通信与信息工程平院(上海 200444) 上海先进信息与数据科学研究院(上海 200444) 上海大学钱伟长院<上海 200444> 上海大学上海电影学(上海 200002) 上海大学机电工程与自动化学院(上海 200444) 通讯作者：李颖洁。E-mail: liyj@i.shu.edu.cn 丰田。E-mail: ouman888@126.com

关键词：情绪视频；脑电；虚拟现实；负性偏向；区域效应

分类号：R318.04

出版年·卷·期（页码）：2021·40·5（478-486）

摘要：

目的研究不同情绪类型的虚拟现实(virtual reality, VR)视频刺激下的脑电(electroencephalogram, EEG)特性，通过分析受试者观看VR视频时的EEG能量，探究不同情绪类型VR视频对受试者神经活动的影响。方法首先制作3种情绪类型(正性、中性、负性)的VR视频，招募30名健康受试者(男18人，女12人），让他们观看这些视频，并完成情绪评价，同时采集他们观看任务时的8通道EEG信号。然后对EEG信号做预处理，包括滤波、去除坏导联及坏段、去除眼电成分、插值及重参考。对处理干净的信号通过小波变换进行分频，检测θ、α、β频带的信号能量。结果正性和中性刺激下在全脑范围的各频带脑电能量都显著高于负性刺激；无论何种情绪的VR视频刺激，都表现出右半球的theta能量显著大于左半球的偏侧化现象，且额区和顶区的alpha能量都显著高于颞区。结论 VR情绪视频能有效诱发特定的情绪，且在VR情绪视频刺激下，存在显著的负性偏向，即负性VR刺激下表现出与正性和中性VR刺激不同的脑电谱特性，表明VR下负性情绪对大脑活动影响的特异性。

Objective The electroencephalogram (EEG) characteristics during virtual reality (VR) videos with different emotions were studied. We investigated the effects of emotional VR videos on the neural activities of subjects by analyzing the EEG power and their behavioral results. Methods Firstly, we designed three emotional types of VR videos (positive, neutral and negative) and recruited 30 healthy subjects (18 men and 12 women) who were required to watch these videos while their 8-channel scalp EEG signals were recorded simultaneously. Then the signal was preprocessed, including filtering, removing bad channels and bad trials, removing eye electrical components, interpolation and re-reference. Finally, theta, alpha and beta activities were detected by wavelet transform. Results EEG power under positive and neutral stimulation was significantly greater than that under negative stimulation in the whole brain regions regardless of theta, alpha and beta bands; no matter what types of simulation, the theta power in the right hemisphere was significantly greater than that in the left hemisphere, and the alpha power in the frontal and parietal regions was significant larger than that in the temporal region. Conclusions VR emotional videos could be used to elicit specific emotions; there was a significant negative bias under the stimulation of VR emotional videos and EEG spectral characteristics under negative stimulation were different from those under positive and neutral stimulation, which showed that the negative emotion has a specific effect on brain activities under VR.

参考文献：

[1]?Kim M, Wang X, Love P, et al. Virtual reality for the built environment: a critical review of recent advances[J]. Journal of Information Technology in Construction, 2013, 18:?279-305.

[2]?Li X, Yi W, Chi HL, et al. A critical review of virtual and augmented reality (VR/AR) applications in construction safety[J]. Automation in Construction, 2018, 86: 150-162.

[3]?Ding N, Zhou W, Fung A YH. Emotional effect of cinematic VR compared with traditional 2D film[J]. Telematics and Informatics, 2018, 35(6): 1572-1579.

[4]?Shin D. Empathy and embodied experience in virtual environment: To what extent can virtual reality stimulate empathy and embodied experience?[J]. Computers in Human Behavior, 2018, 78: 64-73.

[5]?Lay-Ekuakille A, Vergallo P, Griffo G, et al. Entropy index in quantitative EEG measurement for diagnosis accuracy[J]. IEEE Transactions on Instrumentation and Measurement, 2013, 63(6): 1440-1450.

[6]?李颖洁, 樊飞燕, 陈兴时. 脑电分析在认知研究中的进展[J]. 北京生物医学工程, 2006, 25(3):?321-324.

Li?YJ, Fan FY, Chen XS. Development of EEG analysis in the research of cognitive science[J]. Beijing Biomedical Engineering, 2006, 25(3): 321-324.

[7]?Tarrant J, Viczko J, Cope H. Virtual reality for anxiety reduction demonstrated by Quantitative EEG: a pilot study[J]. Frontiers in Psychology, 2018, 9: 1280-1294.

[8]?Bilgin P, Agres K, Robinson N, et al. A comparative study of mental states in 2D and 3D virtual environments using EEG[C]. 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC). Bari, Italy ：IEEE, 2019: 2833-2838.

[9]?Marín-Morales J, Higuera-Trujillo JL, Greco A, et al. Real vs. immersive-virtual emotional experience: Analysis of psycho-physiological patterns in a free exploration of an art museum[J]. PloS one, 2019, 14(10): 1-24.

[10]?Horvat M, Dobrinié M, Novosel M, et al. Assessing emotional responses induced in virtual reality using a consumer EEG headset: A preliminary report[C]//?2018 41st International Convention on Information and Communication Technology, Electronics and Microelectronics (MIPRO). Opatija:?IEEE, 2018: 1006-1010.

[11]?Guo K, Huang J, Yang Y, et al. Effect of virtual reality on fear emotion base on EEG signals analysis[C]. 2019 IEEE MTT-S International Microwave Biomedical Conference (IMBioC). Beijing:IEEE,?2019: 1-4.

[12]?Makeig S, Bell?AJ, Jung TP, et al. Independent component analysis of electroencephalographic data[M]//?Touretzky D, Moser M, Hasselmo M, ed. Advances in Neural Information Processing Systems. Cambridge, MA: MIT Press,1996:?145–151.

[13]?Dong L, Li F, Liu Q, et al. MATLAB toolboxes for reference electrode standardization technique (REST) of Scalp EEG[J]. Frontiers in Neuroscience,?2017, 11: 1-8.

[14]?刘冲, 赵海滨, 李春胜, 等. 脑电信号频带能量特征的提取方法及分类研究[J]. 系统仿真学报, 2012, 24(12):2496-2499

Liu C，Zhao HB, Li CS, et al.?Research on band power extraction and classification of EEG signal[J]. Journal of System Simulation, 2012, 24(12):2496-2499.

[15]?Russell JA. A circumplex model of affect[J]. Journal of Personality and Social Psychology, 1980, 39(6): 1161-1178.

[16]?李颖洁, 朱贻盛, 王继红. 脑电波分析在精神病诊断中的应用[J]. 北京生物医学工程, 2000, 39(4):244-248.

Li YJ, Zhu YS, Wang JH. Application of EEG analysis in the diagnosis of psychosis[J]. Beijing Biomedical Engineering, 2000, 39(4):244-248.

[17]?Russell JA. Core affect and the psychological construction of emotion[J]. Psychological Review, 2003, 10(1):145-172.

[18]?Carretié L, Mercado F, Tapia M, et al. Emotion, attention, and the ‘negativity bias’, studied through event-related potentials[J]. International journal of psychophysiology,?2001, 41(1): 75-85.

[19]?Mogg K, McNamara J, Powys M, et al. Selective attention to threat: A test of two cognitive models of anxiety[J]. Cognition & Emotion. 2000, 14(3): 375-399.

[20]?Akar SA, Kara S, Agambayev S, et al. Nonlinear analysis of EEGs of patients with major depression during different emotional states[J]. Computers in Biology and Medicine,?2015, 67: 49-60.

[21]?Stolz?C, Endres?D, Mueller?EM. Threat-conditioned contexts modulate the late positive potential to faces—A mobile EEG/virtual reality study[J]. Psychophysiology, 2019, 56(4): 13308-13322.

[22]?Pitchford B, Arnell KM. Resting EEG in alpha and beta bands predicts individual differences in attentional breadth[J]. Consciousness and Cognition,?2019, 75: 102803-102823.

[23]?Grimshaw GM, Foster JJ, Corballis PM. Frontal and parietal EEG asymmetries interact to predict attentional bias to threat[J]. Brain and Cognition. 2014, 90: 76-86.

[24]?Weinreich A, Stephani T, Schubert T. Emotion effects within frontal alpha oscillation in a picture oddball paradigm[J]. International Journal of Psychophysiology, 2016, 110: 200-206.

[25]?Koelstra S, Muhl C, Soleymani M, et al. Deap: a?database for emotion analysis; using physiological signals[J]. IEEE Transactions on affective computing, 2011, 3(1): 18-31.

[26]?Ertl M, Hildebrandt M, Ourina K, et al. Emotion regulation by cognitive reappraisal—the role of frontal theta oscillations[J]. NeuroImage, 2013, 81: 412-421.

[27]?Onton JA, Makeig S. High-frequency broadband modulation of electroencephalographic spectra[J]. Frontiers in human neuroscience, 2009, 3: 1-18.

[28]?Laufs H, Kleinschmidt A, Beyerle A, et al. EEG-correlated fMRI of human alpha activity[J]. Neuroimage, 2003, 19(4): 1463-1476.

[29]?Cole HW, Ray WJ. EEG correlates of emotional tasks related to attentional demands[J]. International Journal of Psychophysiology, 1985, 3(1): 33-41.

[30]?Corvec SL, Zhao J. Transport and emotion: how neurosciences could open a new research field[J]. Travel behaviour and society, 2020, 20 20: 12-21.

[31]?Marosi E, Bazán O, Yanez G, et al. Narrow-band spectral measurements of EEG during emotional tasks[J]. International Journal of Neuroscience, 2002, 112(7): 871-891.

[32]?Knyazev GG, Slobodskoj-Plusnin JY, Bocharov AV.?Event-related delta and theta synchronization during explicit and implicit emotion processing[J]. Neuroscience, 2009, 164(4) : 1588-1600.

[33]?Anderson AK, Spencer DD, Fulbright RK, et al. Contribution of the anteromedial temporal lobes to the evaluation of facial emotion[J]. Neuropsychology, 2000, 14(4): 526-536.

[34]?Oakes TR, Pizzagalli DA, Hendrick AM, et al. Functional coupling of simultaneous electrical and metabolic activity in the human brain[J]. Human brain mapping, 2004, 21(4): 257-270.

[35]?Spironelli C, Penolazzi B, Vio C, et al. Inverted EEG theta lateralization in dyslexic children during phonological processing[J]. Neuropsychologia, 2006, 44(14): 2814-2821.

[36]?Ferber S, Ruppel J, Danckert J. Visual working memory deficits following right brain damage[J]. Brain and Cognition, 2020, 142: 105566-105573.

[37]?Niu Y, Wang D, Wang Z, et al. User Experience Evaluation in Virtual Reality based on Subjective Feelings and Physiological Signals[J]. Journal of Imaging Science and Technology, 2019, 63(6): 60413-60423.

[38]?Aftanas LI, Reva NV, Savotina L N, et al. Neurophysiological correlates of induced discrete emotions in humans: an individually oriented analysis[J]. Neuroscience and behavioral Physiology, 2006, 36(2): 119-130.

[39]Barrett LF, Lindquist KA, Bliss-Moreau E, et al. Of mice and men: Natural kinds of emotions in the mammalian brain? A response to Panksepp and Izard[J]. Perspectives on Psychological Science, 2007, 2(3): 297-312.

服务与反馈：

【文章下载】【加入收藏】

提示：您还未登录，请登录！点此登录