用单通道心电图实现动态驾驶中情绪识别,准确率提升6%。
ECG-EmotionNet: Nested Mixture of Expert (NMoE) Adaptation of ECG-Foundation Model for Driver Emotion Recognition
- 通过嵌套专家混合架构适配心电图基础模型,融合多层特征
- 在动态驾驶数据集上实现6%准确率提升与7% F1分数增长
- 适合需要高效实时情绪识别的自动驾驶系统开发者
驾驶员情绪识别在驾驶监控系统中至关重要,有助于提升人机协作与自动驾驶的信任度。尽管多种生理与行为模态已被探索,但心电图(ECG)因其在动态、不可预测驾驶环境中的实时监测优势脱颖而出。现有方法多依赖静态条件下采集的多通道ECG信号,难以适用于真实驾驶场景。为此,本文提出ECG-EmotionNet,一种专为动态驾驶环境设计的新架构,基于最新提出的ECG基础模型(FM),仅使用单通道ECG信号,兼顾泛化能力与计算效率。不同于全微调、线性探测或低秩适应等传统方法,我们提出嵌套专家混合(NMoE)适配策略:将基础模型每个Transformer层视为独立专家,通过可学习门控机制融合各层提取的嵌入表示。该方法有效增强全局与局部心电特征表达,在一个新提出的挑战性驾驶员情绪监测数据集上,实现6%的准确率提升和7%的F1分数增长,且保持高效计算性能。
原文摘要 · Abstract (English)
Driver emotion recognition plays a crucial role in driver monitoring systems, enhancing human-autonomy interactions and the trustworthiness of Autonomous Driving (AD). Various physiological and behavioural modalities have been explored for this purpose, with Electrocardiogram (ECG) emerging as a standout choice for real-time emotion monitoring, particularly in dynamic and unpredictable driving conditions. Existing methods, however, often rely on multi-channel ECG signals recorded under static conditions, limiting their applicability in real-world dynamic driving scenarios. To address this limitation, the paper introduces ECG-EmotionNet, a novel architecture designed specifically for emotion recognition in dynamic driving environments. ECG-EmotionNet is constructed by adapting a recently introduced ECG Foundation Model (FM) and uniquely employs single-channel ECG signals, ensuring both robust generalizability and computational efficiency. Unlike conventional adaptation methods such as full fine-tuning, linear probing, or low-rank adaptation, we propose an intuitively pleasing alternative, referred to as the nested Mixture of Experts (MoE) adaptation. More precisely, each transformer layer of the underlying FM is treated as a separate expert, with embeddings extracted from these experts fused using trainable weights within a gating mechanism. This approach enhances the representation of both global and local ECG features, leading to a 6% improvement in accuracy and a 7% increase in the F1 score, all while maintaining computational efficiency. The effectiveness of the proposed ECG-EmotionNet architecture is evaluated using a recently introduced and challenging driver emotion monitoring dataset.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。