arXiv:2502.09993cs.CV2025-02AAAI被引 13

解决真实场景下表情识别的标签模糊与类别不平衡问题

Navigating Label Ambiguity for Facial Expression Recognition in the Wild

  • 动态识别模糊样本并调整权重,减少模型对多数类的偏见
  • 在多个真实数据集上提升整体与平均准确率,显著抗噪声和类别失衡
  • 适合需要高鲁棒性的实际表情识别应用,如智能客服、人机交互

由于面部表情的主观性及样本噪声,真实场景下的面部表情识别(FER)面临标签模糊的挑战。同时,真实数据集中普遍存在的类别不平衡问题进一步加剧了识别难度。现有方法通常仅解决单一问题,导致效果受限。为此,本文提出新型框架NLA(Navigating Label Ambiguity),首次同步应对标签模糊与类别不平衡。其核心思想是:在训练过程中动态估计并强化模糊样本,从而缓解噪声影响并降低多数类偏见。NLA包含两个关键组件:噪声感知自适应加权(NAW)与一致性正则化。NAW根据预测分数与最近负样本的相关性,自动赋予模糊样本更高权重、噪声样本更低权重;同时引入正则项,确保潜在特征分布一致。实验表明,该框架在多个真实数据集上优于现有方法,在整体准确率与平均准确率上均有显著提升,验证了其对噪声和类别不平衡的强鲁棒性。

原文摘要 · Abstract (English)

Facial expression recognition (FER) remains a challenging task due to label ambiguity caused by the subjective nature of facial expressions and noisy samples. Additionally, class imbalance, which is common in real-world datasets, further complicates FER. Although many studies have shown impressive improvements, they typically address only one of these issues, leading to suboptimal results. To tackle both challenges simultaneously, we propose a novel framework called Navigating Label Ambiguity (NLA), which is robust under real-world conditions. The motivation behind NLA is that dynamically estimating and emphasizing ambiguous samples at each iteration helps mitigate noise and class imbalance by reducing the model's bias toward majority classes. To achieve this, NLA consists of two main components: Noise-aware Adaptive Weighting (NAW) and consistency regularization. Specifically, NAW adaptively assigns higher importance to ambiguous samples and lower importance to noisy ones, based on the correlation between the intermediate prediction scores for the ground truth and the nearest negative. Moreover, we incorporate a regularization term to ensure consistent latent distributions. Consequently, NLA enables the model to progressively focus on more challenging ambiguous samples, which primarily belong to the minority class, in the later stages of training. Extensive experiments demonstrate that NLA outperforms existing methods in both overall and mean accuracy, confirming its robustness against noise and class imbalance. To the best of our knowledge, this is the first framework to address both problems simultaneously.

表情识别标签模糊类别不平衡鲁棒学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。