提出双阶段光流融合网络,提升微表情识别准确率
FMANet: A Novel Dual-Phase Optical Flow Approach with Fusion Motion Attention Network for Robust Micro-expression Recognition
- 设计双阶段光流融合机制,捕捉从开始到峰值及峰值到结束的完整动态
- 在4个标准数据集上达到最高精度,优于现有方法
- 适合情绪分析、安全监控等需要精细动作识别的应用
面部微表情具有细微且短暂的特征,是真实情绪的重要指标。尽管在心理学、安全与行为分析中意义重大,但由于难以捕捉细微面部运动,微表情识别仍具挑战性。光流作为该任务常用输入模态,现有方法多仅计算起始帧到峰值帧间的光流,忽略了峰值到结束阶段的关键运动信息。为此,本文首次提出一种综合运动表征——幅度调制组合光流(MM-COF),将微表情两个阶段的运动动态统一为可直接输入识别网络的描述符。在此基础上,进一步提出FMANet,一种端到端神经网络架构,将双阶段分析与幅度调制内化为可学习模块,使网络能自适应融合运动线索并聚焦显著面部区域进行分类。在MMEW、SMIC、CASME-II和SAMM四个广泛认可的标准基准数据集上的实验表明,所提出的MM-COF表征与FMANet显著优于现有方法,证实了可学习双阶段框架在推进微表情识别中的潜力。
原文摘要 · Abstract (English)
Facial micro-expressions, characterized by their subtle and brief nature, are valuable indicators of genuine emotions. Despite their significance in psychology, security, and behavioral analysis, micro-expression recognition remains challenging due to the difficulty of capturing subtle facial movements. Optical flow has been widely employed as an input modality for this task due to its effectiveness. However, most existing methods compute optical flow only between the onset and apex frames, thereby overlooking essential motion information in the apex-to-offset phase. To address this limitation, we first introduce a comprehensive motion representation, termed Magnitude-Modulated Combined Optical Flow (MM-COF), which integrates motion dynamics from both micro-expression phases into a unified descriptor suitable for direct use in recognition networks. Building upon this principle, we then propose FMANet, a novel end-to-end neural network architecture that internalizes the dual-phase analysis and magnitude modulation into learnable modules. This allows the network to adaptively fuse motion cues and focus on salient facial regions for classification. Experimental evaluations on the MMEW, SMIC, CASME-II, and SAMM datasets, widely recognized as standard benchmarks, demonstrate that our proposed MM-COF representation and FMANet outperforms existing methods, underscoring the potential of a learnable, dual-phase framework in advancing micro-expression recognition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。