arXiv:2508.06640cs.CV2025-08ICCV被引 4

提出CausalNet框架,让微表情识别更抗关键帧误差

Rethinking Key-frame-based Micro-expression Recognition: A Robust and Accurate Framework Against Key-frame Errors

  • 用完整微表情序列输入,结合因果建模提升鲁棒性
  • 在不同噪声水平下仍保持稳定识别性能,超越现有方法
  • 适合实际场景中关键帧标注不精准的微表情分析

微表情识别(MER)是情感计算中的高难度任务。基于关键帧的方法通过提取包含关键信息的缩略输入显著提升了性能,但多数方法依赖较准确的关键帧索引,忽视了获取精确索引的困难及索引误差的客观存在,限制了其实际应用。本文提出CausalNet,一种在关键帧索引误差下仍能实现鲁棒且准确识别的新框架。为增强鲁棒性,CausalNet以整个微表情序列作为输入。为解决完整序列带来的信息冗余并保持准确识别,首先提出因果运动位置学习模块(CMPLM),帮助模型定位与动作单元(AUs)相关的肌肉运动区域,减少对其他冗余区域的关注;其次提出因果注意力块(CAB),深入学习微表情中肌肉收缩与放松之间的因果关系。实验证明,在主流微表情基准上,CausalNet在不同关键帧索引噪声水平下均表现稳健,且在使用标注关键帧时超越多个SOTA方法。代码已开源。

原文摘要 · Abstract (English)

Micro-expression recognition (MER) is a highly challenging task in affective computing. With the reduced-sized micro-expression (ME) input that contains key information based on key-frame indexes, key-frame-based methods have significantly improved the performance of MER. However, most of these methods focus on improving the performance with relatively accurate key-frame indexes, while ignoring the difficulty of obtaining accurate key-frame indexes and the objective existence of key-frame index errors, which impedes them from moving towards practical applications. In this paper, we propose CausalNet, a novel framework to achieve robust MER facing key-frame index errors while maintaining accurate recognition. To enhance robustness, CausalNet takes the representation of the entire ME sequence as the input. To address the information redundancy brought by the complete ME range input and maintain accurate recognition, first, the Causal Motion Position Learning Module (CMPLM) is proposed to help the model locate the muscle movement areas related to Action Units (AUs), thereby reducing the attention to other redundant areas. Second, the Causal Attention Block (CAB) is proposed to deeply learn the causal relationships between the muscle contraction and relaxation movements in MEs. Empirical experiments have demonstrated that on popular ME benchmarks, the CausalNet has achieved robust MER under different levels of key-frame index noise. Meanwhile, it has surpassed state-of-the-art (SOTA) methods on several standard MER benchmarks when using the provided annotated key-frames. Code is available at https://github.com/tony19980810/CausalNet.

微表情识别因果建模鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。