提出自适应方向感知注意力,提升微表情识别在真实场景的泛化能力。
FaceSleuth-R: Adaptive Orientation-Aware Attention for Robust Micro-Expression Recognition
- 设计轻量级SOA模块,让网络自学习最优运动方向以聚焦关键特征
- 在多个数据集上实现超越基线的鲁棒性能,尤其在跨域测试中优势明显
- 适合需要高泛化能力的微表情分析场景,如安防、心理健康评估
微表情识别在受控实验室环境中已取得优异准确率,但在真实场景中因泛化能力差、对领域偏移敏感而难以部署。现有注意力机制常过拟合于数据集特有的外观线索或依赖固定空间先验,导致在复杂环境下表现脆弱。我们认为,鲁棒的微表情识别应关注微表情固有的准不变运动方向,而非表面像素特征。为此,我们提出FaceSleuth-R框架,核心为新型单方向注意力(SOA)模块。SOA是一种轻量级可微算子,使网络能够学习各层最优方向,有效引导注意力聚焦于这些稳健的运动线索。大量实验表明,SOA始终能发现跨不同数据集的普遍近垂直运动先验。更重要的是,FaceSleuth-R在严格的留一数据集外(LODO)协议下展现出卓越泛化能力,显著优于基线与当前最优方法。此外,本方法在多个基准上取得最新成果。该工作揭示了自适应方向感知注意力是构建真正通用且高性能微表情识别系统的关键范式。
原文摘要 · Abstract (English)
Micro-expression recognition (MER) has achieved impressive accuracy in controlled laboratory settings. However, its real-world applicability faces a significant generalization cliff, severely hindering practical deployment due to poor performance on unseen data and susceptibility to domain shifts. Existing attention mechanisms often overfit to dataset-specific appearance cues or rely on fixed spatial priors, making them fragile in diverse environments. We posit that robust MER requires focusing on quasi-invariant motion orientations inherent to micro-expressions, rather than superficial pixel-level features. To this end, we introduce \textbf{FaceSleuth-R}, a framework centered on our novel \textbf{Single-Orientation Attention (SOA)} module. SOA is a lightweight, differentiable operator that enables the network to learn layer-specific optimal orientations, effectively guiding attention towards these robust motion cues. Through extensive experiments, we demonstrate that SOA consistently discovers a universal near-vertical motion prior across diverse datasets. More critically, FaceSleuth-R showcases superior generalization in rigorous Leave-One-Dataset-Out (LODO) protocols, significantly outperforming baselines and state-of-the-art methods when confronted with domain shifts. Furthermore, our approach establishes \textbf{state-of-the-art results} across several benchmarks. This work highlights adaptive orientation-aware attention as a key paradigm for developing truly generalized and high-performing MER systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。