通过多层级对比蒸馏,提升跨被试脑电情绪识别准确率。
Online Multi-level Contrastive Representation Distillation for Cross-Subject fNIRS Emotion Recognition
- 多个轻量学生网络互学,利用多层级特征提取
- 跨被试识别准确率达新高,支持可穿戴部署
- 适合轻量化实时情绪识别场景
利用功能近红外光谱(fNIRS)信号进行情绪识别是理解人类情感的重要进展。然而,由于该领域缺乏人工智能数据与算法,当前研究面临两大挑战:1)便携式可穿戴设备对轻量级模型有更高要求;2)不同被试间生理心理差异显著,加剧了情绪识别难度。为此,本文提出一种新型跨被试fNIRS情绪识别方法——在线多层级对比表示蒸馏框架(OMCRD)。OMCRD是一种用于多个轻量级学生网络间互学的框架,每个子网络采用多层级fNIRS特征提取器,并通过生理信号进行多视角情感挖掘。提出的跨被试交互对比表示(IS-ICR)促进了学生模型间的知识迁移,提升了跨被试情绪识别性能。最优学生网络可被选择并部署于可穿戴设备。实验结果表明,OMCRD在情绪感知与情感意象任务中均达到当前最优表现。
原文摘要 · Abstract (English)
Utilizing functional near-infrared spectroscopy (fNIRS) signals for emotion recognition is a significant advancement in understanding human emotions. However, due to the lack of artificial intelligence data and algorithms in this field, current research faces the following challenges: 1) The portable wearable devices have higher requirements for lightweight models; 2) The objective differences of physiology and psychology among different subjects aggravate the difficulty of emotion recognition. To address these challenges, we propose a novel cross-subject fNIRS emotion recognition method, called the Online Multi-level Contrastive Representation Distillation framework (OMCRD). Specifically, OMCRD is a framework designed for mutual learning among multiple lightweight student networks. It utilizes multi-level fNIRS feature extractor for each sub-network and conducts multi-view sentimental mining using physiological signals. The proposed Inter-Subject Interaction Contrastive Representation (IS-ICR) facilitates knowledge transfer for interactions between student models, enhancing cross-subject emotion recognition performance. The optimal student network can be selected and deployed on a wearable device. Some experimental results demonstrate that OMCRD achieves state-of-the-art results in emotional perception and affective imagery tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。