arXiv:2510.12219cs.CV2025-10IJCAI被引 1

通过分阶段动态图像提升微表情识别准确率

DIANet: A Phase-Aware Dual-Stream Network for Micro-Expression Recognition via Dynamic Images

  • 设计双流网络,分别处理微表情起始到峰值和峰值到结束阶段
  • 在三个基准数据集上均超越传统方法,最高提升6.3%准确率
  • 适合关注情绪识别、安全监控等需要精准行为分析的场景

微表情是持续不到半秒的短暂且无法控制的面部动作,常能揭示真实情绪。准确识别这类细微表情对心理学、安防及行为分析至关重要。然而,由于面部线索微弱且转瞬即逝,加之标注数据有限,微表情识别仍具挑战。尽管动态图像(DI)可将时序运动浓缩为单帧,但传统基于DI的方法常忽略微表情不同时间阶段的特性。为此,本文提出新型双流框架DIANet,利用相位感知的动态图像:一图编码从起始到峰值阶段,另一图捕捉峰值到消退阶段。每一流由独立卷积神经网络处理,并通过交叉注意力融合模块自适应整合两路特征。在CASME-II、SAMM和MMEW三个基准数据集上的大量实验表明,所提方法持续优于传统单相位DI方法,在多个数据集上达到最高6.3%的性能提升。结果凸显显式建模时间相位信息的重要性,为推进微表情识别提供新方向。

原文摘要 · Abstract (English)

Micro-expressions are brief, involuntary facial movements that typically last less than half a second and often reveal genuine emotions. Accurately recognizing these subtle expressions is critical for applications in psychology, security, and behavioral analysis. However, micro-expression recognition (MER) remains a challenging task due to the subtle and transient nature of facial cues and the limited availability of annotated data. While dynamic image (DI) representations have been introduced to summarize temporal motion into a single frame, conventional DI-based methods often overlook the distinct characteristics of different temporal phases within a micro-expression. To address this issue, this paper proposes a novel dual-stream framework, DIANet, which leverages phase-aware dynamic images - one encoding the onset-to-apex phase and the other capturing the apex-to-offset phase. Each stream is processed by a dedicated convolutional neural network, and a cross-attention fusion module is employed to adaptively integrate features from both streams based on their contextual relevance. Extensive experiments conducted on three benchmark MER datasets (CASME-II, SAMM, and MMEW) demonstrate that the proposed method consistently outperforms conventional single-phase DI-based approaches. The results highlight the importance of modeling temporal phase information explicitly and suggest a promising direction for advancing MER.

微表情识别双流网络动态图像注意力机制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。