arXiv:2505.10575cs.CVcs.LG2025-05被引 6

通过自监督持续学习提升脑电情绪识别的鲁棒性

Robust Emotion Recognition via Bi-Level Self-Supervised Continual Learning

  • 分层自监督框架动态维护记忆缓冲区,自动优化伪标签
  • 在两个主流脑电任务上实现跨被试泛化,性能优于现有方法
  • 适合实时连续生理信号流的情绪识别场景

通过脑电图(EEG)等生理信号进行情绪识别已成为情感计算的重要方向,提供了客观捕捉人类情绪的途径。然而,生理数据存在跨被试差异大和标签噪声多的问题,制约了情绪识别模型的表现。现有领域自适应和持续学习方法难以应对这些挑战,尤其是在数据持续流式输入且无标签的现实条件下。为此,我们提出一种基于动态记忆缓冲区的双层自监督持续学习框架SSOCL。该框架通过迭代优化动态缓冲区和伪标签分配,有效保留代表性样本,实现从连续、无标签的生理数据流中进行情绪识别的泛化。所生成的伪标签随后用于精确情绪预测。框架的关键组件,包括快速适应模块和聚类映射模块,提升了学习鲁棒性并有效处理演化数据流。在两个主流脑电任务上的实验验证表明,该框架能适应连续数据流,并保持强跨被试泛化能力,优于现有方法。

原文摘要 · Abstract (English)

Emotion recognition through physiological signals such as electroencephalogram (EEG) has become an essential aspect of affective computing and provides an objective way to capture human emotions. However, physiological data characterized by cross-subject variability and noisy labels hinder the performance of emotion recognition models. Existing domain adaptation and continual learning methods struggle to address these issues, especially under realistic conditions where data is continuously streamed and unlabeled. To overcome these limitations, we propose a novel bi-level self-supervised continual learning framework, SSOCL, based on a dynamic memory buffer. This bi-level architecture iteratively refines the dynamic buffer and pseudo-label assignments to effectively retain representative samples, enabling generalization from continuous, unlabeled physiological data streams for emotion recognition. The assigned pseudo-labels are subsequently leveraged for accurate emotion prediction. Key components of the framework, including a fast adaptation module and a cluster-mapping module, enable robust learning and effective handling of evolving data streams. Experimental validation on two mainstream EEG tasks demonstrates the framework's ability to adapt to continuous data streams while maintaining strong generalization across subjects, outperforming existing approaches.

情绪识别脑电图持续学习自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。