arXiv:2510.13493cs.CVcs.LG2025-10被引 3

混合CNN与专家模型,提升复杂场景下情绪识别准确率。

ExpressNet-MoE: A Hybrid Deep Neural Network for Emotion Recognition

  • 结合CNN与专家混合架构,动态选择最优特征提取路径。
  • 在AffectNet、RAF-DB等数据集上最高达84.29%准确率。
  • 适合需高适应性的实际情绪识别系统开发。

在在线教育、医疗、安防和人机交互等领域,面部情绪识别(FER)至关重要。然而,由于头部姿态变化、遮挡、光照差异和人口多样性等因素,真实世界中的FER仍具挑战性。当前模型的局限性使得参与度检测(如虚拟学习、客户服务)难以实现。本文提出ExpressNet-MoE,一种融合卷积神经网络(CNN)与专家混合(MoE)框架的新型混合深度学习模型,以克服上述难题。该模型通过动态选择最相关的专家网络,增强泛化能力并提高跨数据集适应性。利用多尺度特征提取,同时捕捉全局与局部面部特征。模型包含多个基于CNN的特征提取器、用于自适应特征选择的MoE模块,以及用于深层特征学习的残差网络主干。在多个数据集上的实验表明,其在AffectNet(v7)上达到74.77%准确率,AffectNet(v8)为72.55%,RAF-DB为84.29%,FER-2013为64.66%。结果验证了模型的自适应性,展示了其在实际应用中构建端到端情绪识别系统的潜力。可复现代码与结果已公开于https://github.com/DeeptimaanB/ExpressNet-MoE。

原文摘要 · Abstract (English)

In many domains, including online education, healthcare, security, and human-computer interaction, facial emotion recognition (FER) is essential. Real-world FER is still difficult despite its significance because of some factors such as variable head positions, occlusions, illumination shifts, and demographic diversity. Engagement detection, which is essential for applications like virtual learning and customer services, is frequently challenging due to FER limitations by many current models. In this article, we propose ExpressNet-MoE, a novel hybrid deep learning model that blends both Convolution Neural Networks (CNNs) and Mixture of Experts (MoE) framework, to overcome the difficulties. Our model dynamically chooses the most pertinent expert networks, thus it aids in the generalization and providing flexibility to model across a wide variety of datasets. Our model improves on the accuracy of emotion recognition by utilizing multi-scale feature extraction to collect both global and local facial features. ExpressNet-MoE includes numerous CNN-based feature extractors, a MoE module for adaptive feature selection, and finally a residual network backbone for deep feature learning. To demonstrate efficacy of our proposed model we evaluated on several datasets, and compared with current state-of-the-art methods. Our model achieves accuracies of 74.77% on AffectNet (v7), 72.55% on AffectNet (v8), 84.29% on RAF-DB, and 64.66% on FER-2013. The results show how adaptive our model is and how it may be used to develop end-to-end emotion recognition systems in practical settings. Reproducible codes and results are made publicly accessible at https://github.com/DeeptimaanB/ExpressNet-MoE.

情绪识别混合模型深度学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。