arXiv:2603.04766cs.CVcs.CY2026-03被引 3

通过动态重选关键帧,减少跨文化微表情标注误差。

Evaluating and Correcting Human Annotation Bias in Dynamic Micro-Expression Recognition

  • 用动态机制重选微表情的起始与峰值帧,提升时序建模精度。
  • 在7个数据集上验证,显著降低跨文化数据中偏移帧标注不确定性。
  • 无需增加参数即可融入现有模型,适合微表情识别研究者使用。

现有微表情人工标注易出现准确性偏差,尤其在跨文化场景下关键帧标注差异更明显。本文提出全局非单调差分选择策略(GAMDSS),通过动态重选机制从完整动作序列中识别起始帧和峰值帧(具有显著微表情变化),进而确定偏移帧并构建丰富的时空动态表征。采用共享参数的双分支结构高效提取时空特征。在七个广泛使用的微表情数据集上进行大量实验,结果表明GAMDSS有效降低了SAMM和4DME等跨文化数据集中由人为因素引起的主观误差。定量分析进一步证实跨文化数据集中偏移帧标注更具不确定性,为标准化微表情标注提供了理论依据。该设计可无缝集成至现有模型而不增加参数量,为提升微表情识别性能提供新思路。源代码已公开于GitHub。

原文摘要 · Abstract (English)

Existing manual labeling of micro-expressions is subject to errors in accuracy, especially in cross-cultural scenarios where deviation in labeling of key frames is more prominent. To address this issue, this paper presents a novel Global Anti-Monotonic Differential Selection Strategy (GAMDSS) architecture for enhancing the effectiveness of spatio-temporal modeling of micro-expressions through keyframe re-selection. Specifically, the method identifies Onset and Apex frames, which are characterized by significant micro-expression variation, from complete micro-expression action sequences via a dynamic frame reselection mechanism. It then uses these to determine Offset frames and construct a rich spatio-temporal dynamic representation. A two-branch structure with shared parameters is then used to efficiently extract spatio-temporal features. Extensive experiments are conducted on seven widely recognized micro-expression datasets. The results demonstrate that GAMDSS effectively reduces subjective errors caused by human factors in multicultural datasets such as SAMM and 4DME. Furthermore, quantitative analyses confirm that offset-frame annotations in multicultural datasets are more uncertain, providing theoretical justification for standardizing micro-expression annotations. These findings directly support our argument for reconsidering the validity and generalizability of dataset annotation paradigms. Notably, this design can be integrated into existing models without increasing the number of parameters, offering a new approach to enhancing micro-expression recognition performance. The source code is available on GitHub[https://github.com/Cross-Innovation-Lab/GAMDSS].

微表情识别标注偏差时空建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。