arXiv:2510.04174cs.CV2025-10

无需先验知识,用生成模型自适应去偏,提升模型鲁棒性。

BLADE: Bias-Linked Adaptive DEbiasing

  • 构建生成模型跨偏见域转换图像,保留任务相关特征
  • 在最差组设置下,比最强基线高18%准确率
  • 适合无偏见先验信息的现实场景应用

神经网络虽已革新众多领域,但仍易学习隐式偏见——训练数据中某些属性与目标标签之间的虚假相关性。这些偏见往往更显著且易被模型捕捉,导致模型依赖表面模式而非任务相关特征,影响泛化能力。现有方法通常依赖强假设,如已知偏见或获取与偏见冲突的样本(即违背虚假相关性的样本)。然而这些假设在真实场景中常不切实际。本文提出BLADE(Bias-Linked Adaptive DEbiasing),一种无需偏见先验或偏见冲突样本的生成式去偏框架。首先训练生成模型,在保持任务相关特征的前提下,将图像在不同偏见域间转换;随后根据图像对偏见的敏感度,自适应地以合成图像修正原图。为促进鲁棒表征,BLADE将图像与其共享任务特征但偏见不同的合成图像对齐,同时与同偏见样本错开对齐。在多个基准数据集上的实验表明,该方法显著优于现有最佳方法。尤其在最差组设置下,于损坏的CIFAR-10数据集上超越最接近基线约18个百分点,树立了去偏新基准,展示了无需显式监督即可构建更鲁棒深度学习模型的潜力。

原文摘要 · Abstract (English)

Neural networks have revolutionized numerous fields, yet they remain vulnerable to a critical flaw: the tendency to learn implicit biases, spurious correlations between certain attributes and target labels in training data. These biases are often more prevalent and easier to learn, causing models to rely on superficial patterns rather than task-relevant features necessary for generalization. Existing methods typically rely on strong assumptions, such as prior knowledge of these biases or access to bias-conflicting samples, i.e., samples that contradict spurious correlations and counterbalance bias-aligned samples, samples that conform to these spurious correlations. However, such assumptions are often impractical in real-world settings. We propose BLADE ({B}ias-{L}inked {A}daptive {DE}biasing), a generative debiasing framework that requires no prior knowledge of bias or bias-conflicting samples. BLADE first trains a generative model to translate images across bias domains while preserving task-relevant features. Then, it adaptively refines each image with its synthetic counterpart based on the image's susceptibility to bias. To encourage robust representations, BLADE aligns an image with its bias-translated synthetic counterpart that shares task-relevant features but differs in bias, while misaligning it with samples sharing the same bias. We evaluate BLADE on multiple benchmark datasets and show that it significantly outperforms state-of-the-art methods. Notably, it exceeds the closest baseline by an absolute margin of around 18% on the corrupted CIFAR-10 dataset under the worst group setting, establishing a new benchmark in bias mitigation and demonstrating its potential for developing more robust deep learning models without explicit supervision.

去偏生成模型鲁棒性无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。