用动态潜空间与强化学习,提升脑电情绪连续预测精度
EEGDancer: Dynamic Emotion Latent Space Masked Modeling with Reinforcement Learning for EEG Continuous Emotion Prediction

- 构建脑电情绪的离散-连续混合潜空间,捕捉情绪演化模式
- 在三个数据集上超越现有方法,相关系数提升显著
- 适合做情绪计算、脑机接口研究者参考
连续脑电(EEG)情绪预测旨在建模人类情感状态随时间的演变。与传统离散情绪识别不同,连续预测需捕捉长程时序依赖和连贯的情绪动态。但现有方法多依赖逐帧回归,直接建模高维噪声脑电信号,难以刻画连续情绪演化。为此,本文提出EEGDancer,一个面向连续脑电情绪预测的动态情绪潜空间学习框架。该框架整合向量量化表示学习、掩码时序建模与基于强化学习的轨迹优化。具体地,设计因果时空向量量化变分自编码器(VQ-VAE),从脑电信号中学习结构化情绪原型,构建离散-连续情绪潜空间;基于学习的潜表示,采用Transformer-based掩码动态建模策略,捕捉长程情绪依赖与时序演化模式;进一步将连续情绪预测建模为序列决策问题,引入软演员-批评(SAC)框架,在序列层面优化情绪预测轨迹,而非帧级局部拟合。在SEED、SEED-IV和Long-Term Naturalistic Emotion数据集上的大量实验表明,EEGDancer持续优于现有机器学习与深度学习方法。消融实验证实所提潜空间与强化学习轨迹优化对建模连续脑电情绪动态的有效性。
原文摘要 · Abstract (English)
Continuous electroencephalography (EEG) emotion prediction aims to model the temporal evolution of human emotional states from EEG signals. Unlike conventional discrete emotion recognition, continuous prediction requires capturing long-range temporal dependencies and coherent emotional dynamics. However, existing methods mainly rely on point-wise regression and directly model noisy high-dimensional EEG features, limiting their ability to characterize continuous emotional evolution.To address these challenges, we propose EEGDancer, a dynamic emotional latent space learning framework for continuous EEG emotion prediction. The framework integrates vector-quantized representation learning, masked temporal modeling, and reinforcement learning-based trajectory optimization into a unified architecture.Specifically, a causal spatiotemporal Vector-Quantization Variational Autoencoder (VQ-VAE) is designed to learn structured emotional prototypes and construct a discrete-continuous emotional latent space from EEG signals. Based on the learned latent representations, a Transformer-based masked dynamic modeling strategy captures long-range emotional dependencies and temporal evolution patterns. Furthermore, continuous emotion prediction is formulated as a sequential decision-making problem, and a Soft Actor-Critic (SAC) framework is introduced to optimize emotional prediction trajectories at the sequence level instead of frame-wise local fitting.Extensive experiments on the SEED, SEED-IV, and Long-Term Naturalistic Emotion datasets demonstrate that EEGDancer consistently outperforms existing machine learning and deep learning methods. Ablation studies further verify the effectiveness of the proposed latent space and reinforcement learning-based trajectory optimization for modeling continuous EEG emotional dynamics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。