通过动态图像融合提升微表情识别准确率,突破现有方法极限。
Adaptive Fusion Network with Temporal-Ranked and Motion-Intensity Dynamic Images for Micro-expression Recognition
- 构建时序排序与运动强度动态图像,捕捉细微面部变化
- 自适应融合网络在CASME-II上达93.95%准确率,创历史新高
- 适合情感计算、测谎与人机交互领域研究者参考
微表情是强度极低、持续时间短暂的面部细微变化,肉眼几乎无法察觉,却能揭示真实情绪,在谎言检测、行为分析和心理评估中具有重要价值。本文提出一种新型微表情识别方法,主要贡献有二:其一,设计两种互补表征——时序排序动态图像(强调时间演变)与运动强度动态图像(通过帧重排机制突出微小运动);其二,提出自适应融合网络,自动学习最优整合方式,增强判别性特征并抑制噪声。在三个基准数据集(CASME-II、SAMM、MMEW)上的实验表明,该方法性能优越:在CASME-II上达到93.95%准确率与0.897 UF1,刷新当前最佳纪录;在SAMM上取得82.47%准确率与0.665 UF1,类别间表现更均衡;在MMEW上实现76.00%准确率,验证了良好的泛化能力。结果表明,输入表示与网络架构共同推动性能提升,为情感计算、测谎及人机交互领域的研究与应用奠定坚实基础。
原文摘要 · Abstract (English)
Micro-expressions (MEs) are subtle, transient facial changes with very low intensity, almost imperceptible to the naked eye, yet they reveal a person genuine emotion. They are of great value in lie detection, behavioral analysis, and psychological assessment. This paper proposes a novel MER method with two main contributions. First, we propose two complementary representations - Temporal-ranked dynamic image, which emphasizes temporal progression, and Motion-intensity dynamic image, which highlights subtle motions through a frame reordering mechanism incorporating motion intensity. Second, we propose an Adaptive fusion network, which automatically learns to optimally integrate these two representations, thereby enhancing discriminative ME features while suppressing noise. Experiments on three benchmark datasets (CASME-II, SAMM and MMEW) demonstrate the superiority of the proposed method. Specifically, AFN achieves 93.95 Accuracy and 0.897 UF1 on CASME-II, setting a new state-of-the-art benchmark. On SAMM, the method attains 82.47 Accuracy and 0.665 UF1, demonstrating more balanced recognition across classes. On MMEW, the model achieves 76.00 Accuracy, further confirming its generalization ability. The obtained results show that both the input and the proposed architecture play important roles in improving the performance of MER. Moreover, they provide a solid foundation for further research and practical applications in the fields of affective computing, lie detection, and human-computer interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。