用先验知识减少表情标注主观性,提升识别鲁棒性
Prior-based Objective Inference Mining Potential Uncertainty for Facial Expression Recognition
- 基于面部动作单元先验,动态融合多区域信息推断情绪分布
- 在真实数据集上准确率提升3.2%,噪声数据下稳定性显著增强
- 适合处理标注不一致的野外表情识别场景
视觉判断的主观性导致面部表情识别(FER)任务中存在标注模糊问题,尤其在大规模野外数据集中更为突出。本文提出一种基于先验的目标推断(POI)网络,通过引入面部动作单元(AUs)与情绪的先验知识,生成更客观且多样化的表达分布,以缓解主观标注带来的歧义。POI包含两个核心模块:首先,先验推断网络(PIN)利用先验知识捕捉精细运动特征,并通过聚合多个关键面部子区域的推断知识,促进相互学习,避免过度依赖先验;其次,目标识别网络(TRN)融合主观情绪标注与PIN提供的客观软标签,理解表情固有差异性,从而解决标注模糊问题。此外,引入不确定性估计模块,量化并平衡表情置信度,实现对主观标注不确定性的灵活处理。大量实验表明,POI在合成噪声数据集和多个真实世界数据集上均表现优异,性能具有竞争力。代码与训练日志将公开于https://github.com/liuhw01/POI。
原文摘要 · Abstract (English)
Annotation ambiguity caused by the inherent subjectivity of visual judgment has always been a major challenge for Facial Expression Recognition (FER) tasks, particularly for largescale datasets from in-the-wild scenarios. A potential solution is the evaluation of relatively objective emotional distributions to help mitigate the ambiguity of subjective annotations. To this end, this paper proposes a novel Prior-based Objective Inference (POI) network. This network employs prior knowledge to derive a more objective and varied emotional distribution and tackles the issue of subjective annotation ambiguity through dynamic knowledge transfer. POI comprises two key networks: Firstly, the Prior Inference Network (PIN) utilizes the prior knowledge of AUs and emotions to capture intricate motion details. To reduce over-reliance on priors and facilitate objective emotional inference, PIN aggregates inferential knowledge from various key facial subregions, encouraging mutual learning. Secondly, the Target Recognition Network (TRN) integrates subjective emotion annotations and objective inference soft labels provided by the PIN, fostering an understanding of inherent facial expression diversity, thus resolving annotation ambiguity. Moreover, we introduce an uncertainty estimation module to quantify and balance facial expression confidence. This module enables a flexible approach to dealing with the uncertainties of subjective annotations. Extensive experiments show that POI exhibits competitive performance on both synthetic noisy datasets and multiple real-world datasets. All codes and training logs will be publicly available at https://github.com/liuhw01/POI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。