arXiv:2508.05934cs.HCcs.AI2025-08

解决生理信号缺失时的情绪特征选择问题,提升多模态情感识别性能。

ASLSL: Adaptive shared latent structure learning with incomplete multi-modal physiological data for multi-dimensional emotional feature selection

  • 基于相似特征共享情绪标签的特性,学习跨模态的共同潜在结构。
  • 在DEAP和DREAMER数据集上,相比17种方法显著提升分类准确率。
  • 适用于真实场景中不完整生理信号的情感分析研究者。

近年来,基于多模态生理信号的情绪识别在脑机接口领域受到越来越多关注。然而,相关生理特征通常维度高,包含大量无关、冗余和噪声信息,易导致分类器过拟合、性能差及计算复杂度高。特征选择被广泛用于应对这些挑战。但以往研究多假设多模态生理数据完整,而实际中因采集环境开放,数据常存在缺失,例如部分样本仅在少数模态中有数据。为此,本文提出一种针对不完整多模态生理信号的特征选择新方法——自适应共享潜在结构学习(ASLSL)。该方法基于相似特征具有相似情绪标签的特性,通过自适应共享潜在结构学习,构建跨不完整多模态生理信号与多维情绪标签的公共潜在空间,从而缓解缺失信息影响并挖掘一致信息。在两个主流多模态生理情绪数据集DEAP和DREAMER上,对比了ASLSL与17种特征选择方法的性能。全面实验结果验证了ASLSL的有效性。

原文摘要 · Abstract (English)

Recently, multi-modal physiological signals based emotion recognition has garnered increasing attention in the field of brain-computer interfaces. Nevertheness, the associated multi-modal physiological features are often high-dimensional and inevitably include irrelevant, redundant, and noisy representation, which can easily lead to overfitting, poor performance, and high computational complexity in emotion classifiers. Feature selection has been widely applied to address these challenges. However, previous studies generally assumed that multi-modal physiological data are complete, whereas in reality, the data are often incomplete due to the openness of the acquisition and operational environment. For example, a part of samples are available in several modalities but not in others. To address this issue, we propose a novel method for incomplete multi-modal physiological signal feature selection called adaptive shared latent structure learning (ASLSL). Based on the property that similar features share similar emotional labels, ASLSL employs adaptive shared latent structure learning to explore a common latent space shared for incomplete multi-modal physiological signals and multi-dimensional emotional labels, thereby mitigating the impact of missing information and mining consensus information. Two most popular multi-modal physiological emotion datasets (DEAP and DREAMER) with multi-dimensional emotional labels were utilized to compare the performance between compare ASLSL and seventeen feature selection methods. Comprehensive experimental results on these datasets demonstrate the effectiveness of ASLSL.

情绪识别多模态特征选择缺失数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。