arXiv:2604.21227cs.CVcs.MM2026-04中稿 · ICMR 2026

通过建模表示与决策阶段的不确定性,提升面部动作单元检测的鲁棒性。

UAU-Net: Uncertainty-aware Representation Learning and Evidential Classification for Facial Action Unit Detection

论文配图:UAU-Net: Uncertainty-aware Representation Learning and Evidential Classification for Facial Action Unit Detection
图 1 · 摘自论文原文
  • 用条件变分自编码器学习带方差的动态特征,捕捉多尺度不确定性。
  • 基于非对称贝塔分布的证据神经网络,缓解标签不平衡导致的过度自信。
  • 在BP4D和DISFA数据集上表现优越,适合高噪声或小样本场景应用。

面部动作单元(AU)检测因表示与决策阶段的异质性不确定性而面临挑战。现有方法虽提升了判别性特征学习,但通常将特征视为确定性,忽略了视觉噪声、个体外观差异及跨AU关系模糊带来的不确定性,严重影响鲁棒性。传统点估计分类器常产生校准不足的置信度,尤其在严重标签不平衡的AU数据集中表现过拟合。我们提出UAU-Net,一种双阶段不确定性感知框架:在表示阶段引入CV-AFE(条件变分自编码器基的特征提取模块),通过联合估计多时空尺度下的特征均值与方差,生成概率化特征,并利用AU标签条件建模跨AU依赖不确定性;在决策阶段设计AB-ENN(非对称贝塔证据神经网络),以贝塔分布参数化预测不确定性,采用针对高度不平衡二值标签的非对称损失抑制过自信。在BP4D与DISFA数据集上的大量实验表明,UAU-Net实现强检测性能,进一步分析显示,同时建模表示与证据预测中的不确定性显著提升系统鲁棒性与可靠性。

原文摘要 · Abstract (English)

Facial action unit (AU) detection remains challenging because it involves heterogeneous, AU-specific uncertainties arising at both the representation and decision stages. Recent methods have improved discriminative feature learning, but they often treat the AU representations as deterministic, overlooking uncertainty caused by visual noise, subject-dependent appearance variations, and ambiguous inter-AU relationships, all of which can substantially degrade robustness. Meanwhile, conventional point-estimation classifiers often provide poorly calibrated confidence, producing overconfident predictions, especially under the severe label imbalance typical of AU datasets. We propose UAU-Net, an Uncertainty-aware AU detection framework that explicitly models uncertainty at both stages. At the representation stage, we introduce CV-AFE, a conditional VAE (CVAE)-based AU feature extraction module that learns probabilistic AU representations by jointly estimating feature means and variances across multiple spatio-temporal scales; conditioning on AU labels further enables CV-AFE to capture uncertainty associated with inter-AU dependencies. At the decision stage, we design AB-ENN, an Asymmetric Beta Evidential Neural Network for multi-label AU detection, which parameterizes predictive uncertainty with Beta distributions and mitigates overconfidence via an asymmetric loss tailored to highly imbalanced binary labels. Extensive experiments on BP4D and DISFA show that UAU-Net achieves strong AU detection performance, and further analyses indicate that modeling uncertainty in both representation learning and evidential prediction improves robustness and reliability.

面部动作检测不确定性建模证据推理多标签学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。