融合多重先验信息,提升微表情识别准确率。
MPFNet: A Multi-Prior Fusion Network with a Progressive Training Strategy for Micro-Expression Recognition
- 设计双编码器结构,结合通用与高级特征提取
- 在SMIC、CASME II、SAMM数据集上分别达81.1%、92.4%、85.7%准确率
- 基于婴幼儿认知发展机制,支持并行与分层融合策略
微表情识别(MER)是情感计算的关键分支,因其持续时间短、强度低,比宏观表情识别更具挑战性。现有方法多依赖单一来源的先验知识,未能充分挖掘多源信息。本文提出多先验融合网络(MPFNet),采用渐进式训练策略优化MER任务。设计两个互补编码器:通用特征编码器(GFE)和高级特征编码器(AFE),均基于带坐标注意力机制的膨胀3D卷积网络(I3D),以增强时空与通道特异性捕捉能力。受儿童认知发展心理学启发,提出MPFNet-P(并行)与MPFNet-C(分层)两种变体,用于评估不同先验融合策略。大量实验表明,MPFNet显著提升识别准确率且类别间性能均衡,在SMIC、CASME II、SAMM数据集上分别达到81.1%、92.4%、85.7%。据我们所知,该方法在SMIC和SAMM数据集上达到当前最优水平。
原文摘要 · Abstract (English)
Micro-expression recognition (MER), a critical subfield of affective computing, presents greater challenges than macro-expression recognition due to its brief duration and low intensity. While incorporating prior knowledge has been shown to enhance MER performance, existing methods predominantly rely on simplistic, singular sources of prior knowledge, failing to fully exploit multi-source information. This paper introduces the Multi-Prior Fusion Network (MPFNet), leveraging a progressive training strategy to optimize MER tasks. We propose two complementary encoders: the Generic Feature Encoder (GFE) and the Advanced Feature Encoder (AFE), both based on Inflated 3D ConvNets (I3D) with Coordinate Attention (CA) mechanisms, to improve the model's ability to capture spatiotemporal and channel-specific features. Inspired by developmental psychology, we present two variants of MPFNet--MPFNet-P and MPFNet-C--corresponding to two fundamental modes of infant cognitive development: parallel and hierarchical processing. These variants enable the evaluation of different strategies for integrating prior knowledge. Extensive experiments demonstrate that MPFNet significantly improves MER accuracy while maintaining balanced performance across categories, achieving accuracies of 0.811, 0.924, and 0.857 on the SMIC, CASME II, and SAMM datasets, respectively. To the best of our knowledge, our approach achieves state-of-the-art performance on the SMIC and SAMM datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。