通过量化模型不确定性,无需标注即可消除模型对表面关联的依赖。
Improving Group Robustness on Spurious Correlation via Evidential Alignment
- 用不确定性量化分析模型偏差,不依赖外部标注。
- 在多个数据集上显著提升不同架构的组鲁棒性。
- 适合需要提升模型公平性与泛化能力的研究者。
深度神经网络常依赖虚假相关性(如图像分类器通过沙漠背景识别骆驼),导致分布外性能下降。现有方法需外部分组标注或辅助确定性模型,成本高且难以捕捉全部偏差。本文提出证据对齐(Evidential Alignment)框架,利用不确定性量化分析有偏模型行为,无需任何虚假相关性标注。通过二阶风险最小化量化预测证据,并采用提出的证据校准技术,有效识别并抑制虚假相关性,同时保留关键特征。理论上证明该方法能学习模型偏差模式并实现去偏。实验表明,该方法在多种架构和模态下显著提升组鲁棒性,提供了一种可扩展、原理清晰的解决方案。
原文摘要 · Abstract (English)
Deep neural networks often learn and rely on spurious correlations, i.e., superficial associations between non-causal features and the targets. For instance, an image classifier may identify camels based on the desert backgrounds. While it can yield high overall accuracy during training, it degrades generalization on more diverse scenarios where such correlations do not hold. This problem poses significant challenges for out-of-distribution robustness and trustworthiness. Existing methods typically mitigate this issue by using external group annotations or auxiliary deterministic models to learn unbiased representations. However, such information is costly to obtain, and deterministic models may fail to capture the full spectrum of biases learned by the models. To address these limitations, we propose Evidential Alignment, a novel framework that leverages uncertainty quantification to understand the behavior of the biased models without requiring group annotations. By quantifying the evidence of model prediction with second-order risk minimization and calibrating the biased models with the proposed evidential calibration technique, Evidential Alignment identifies and suppresses spurious correlations while preserving core features. We theoretically justify the effectiveness of our method as capable of learning the patterns of biased models and debiasing the model without requiring any spurious correlation annotations. Empirical results demonstrate that our method significantly improves group robustness across diverse architectures and data modalities, providing a scalable and principled solution to spurious correlations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。