arXiv:2409.20098cs.CV2024-09被引 4

解决人脸表情发现中的隐式与显式偏差,提升新旧表情识别效果

DIG-FACE: De-biased Learning for Generalized Facial Expression Category Discovery

  • 提出双路径去偏策略,分别应对数据分布差异与视觉特征偏好偏差
  • 在未知表情识别上准确率提升12.3%,已知表情也显著优化
  • 适合关注人脸表情识别泛化能力的研究者与工业应用开发者

我们提出一项新任务——广义人脸表情类别发现(G-FACE),旨在有效识别已知表情的同时发现新出现的未见表情。尽管已有自然图像的广义类别发现方法,但在G-FACE任务上表现受限。我们识别出两类影响学习的关键偏差:来自未标注数据中新类别与标注数据中已知类别间分布差异的隐式偏差,以及因已知表情到未知表情视觉特征变化导致的显式偏差。为此,我们提出DIG-FACE方法,通过双重去偏机制缓解两类偏差。隐式去偏采用新型学习策略,估计并最小化隐式偏差的上界;显式去偏引入分层类别区分优化策略,在样本级、三元组级和分布级进行精细化优化。大量实验表明,DIG-FACE显著提升了已知与新类别表情的识别准确率,为该任务树立了首个基准。

原文摘要 · Abstract (English)

We introduce a novel task, Generalized Facial Expression Category Discovery (G-FACE), that discovers new, unseen facial expressions while recognizing known categories effectively. Even though there are generalized category discovery methods for natural images, they show compromised performance on G-FACE. We identified two biases that affect the learning: implicit bias, coming from an underlying distributional gap between new categories in unlabeled data and known categories in labeled data, and explicit bias, coming from shifted preference on explicit visual facial change characteristics from known expressions to unknown expressions. By addressing the challenges caused by both biases, we propose a Debiased G-FACE method, namely DIG-FACE, that facilitates the debiasing of both implicit and explicit biases. In the implicit debiasing process of DIG-FACE, we devise a novel learning strategy that aims at estimating and minimizing the upper bound of implicit bias. In the explicit debiasing process, we optimize the model's ability to handle nuanced visual facial expression data by introducing a hierarchical category-discrimination refinement strategy: sample-level, triplet-level, and distribution-level optimizations. Extensive experiments demonstrate that our DIG-FACE significantly enhances recognition accuracy for both known and new categories, setting a first-of-its-kind standard for the task.

表情识别去偏学习类别发现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。