arXiv:2411.01757cs.LGcs.AI2024-11NeurIPS被引 7

无需偏见标签,通过预测分歧识别无伪相关样本并重采样提升模型鲁棒性

Mitigating Spurious Correlations via Disagreement Probability

  • 利用有偏模型预测与真实标签的分歧识别无伪相关样本
  • 在多个基准上超越无偏见标签的现有方法,性能领先
  • 理论证明该方法能降低对伪相关性的依赖,适合数据偏见不可知场景

基于经验风险最小化的模型容易受目标标签与偏见属性间伪相关的影响,导致在缺乏伪相关性的数据组上表现不佳。当无法获取偏见标签时,该问题尤为严峻。为此,本文提出一种新颖的训练目标,旨在提升所有样本上的模型性能,无论是否存在伪相关。由此推导出无需偏见标签的去偏方法——基于分歧概率的重采样(DPR)。DPR利用有偏模型预测与真实标签之间的分歧,识别出无伪相关的偏差冲突样本,并根据分歧概率进行重采样。在多个基准上的实证评估表明,DPR在不使用偏见标签的方法中达到最先进水平。此外,本文提供了理论分析,说明DPR如何减少对伪相关性的依赖。

原文摘要 · Abstract (English)

Models trained with empirical risk minimization (ERM) are prone to be biased towards spurious correlations between target labels and bias attributes, which leads to poor performance on data groups lacking spurious correlations. It is particularly challenging to address this problem when access to bias labels is not permitted. To mitigate the effect of spurious correlations without bias labels, we first introduce a novel training objective designed to robustly enhance model performance across all data samples, irrespective of the presence of spurious correlations. From this objective, we then derive a debiasing method, Disagreement Probability based Resampling for debiasing (DPR), which does not require bias labels. DPR leverages the disagreement between the target label and the prediction of a biased model to identify bias-conflicting samples-those without spurious correlations-and upsamples them according to the disagreement probability. Empirical evaluations on multiple benchmarks demonstrate that DPR achieves state-of-the-art performance over existing baselines that do not use bias labels. Furthermore, we provide a theoretical analysis that details how DPR reduces dependency on spurious correlations.

去偏学习伪相关无标签

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。