通过自动排序样本的虚假线索程度,实现无需人工标注的去偏。
Sebra: Debiasing Through Self-Guided Bias Ranking
- 利用ERM训练中学习难易度与虚假线索的相关性,自动排序样本
- 在多个基准上超越现有无监督去偏方法,提升显著
- 适合需要低成本去偏的视觉模型开发场景
通过细粒度估计样本中虚假线索的程度进行排序,近期被证明比传统的二元划分(有偏/无偏)更有效缓解偏差。然而,这种排序依赖人工标注。本文提出一种基于自引导偏差排序(Sebra)的去偏框架,通过在各类别内自动对数据点按虚假线索程度排序来减轻偏差。Sebra利用经验风险最小化(ERM)训练中的局部对称性:样本越少依赖虚假关联,学习难度越高;反之则越容易。但全局迭代中,ERM会偏离此对称性。Sebra动态引导ERM修正该偏差,实现按难度递增顺序(即虚假线索递减)逐步学习属性。由此生成的学习序列天然提供虚假线索排序。进一步将此细粒度偏差表征用于对比学习,从多源削弱偏差。大量实验表明,Sebra在多个标准基准(UrbanCars、BAR、CelebA、ImageNet-1K)上持续优于现有最先进的无监督去偏技术。代码、预训练模型及训练日志见https://kadarsh22.github.io/sebra_iclr25/。
原文摘要 · Abstract (English)
Ranking samples by fine-grained estimates of spuriosity (the degree to which spurious cues are present) has recently been shown to significantly benefit bias mitigation, over the traditional binary biased-\textit{vs}-unbiased partitioning of train sets. However, this spuriosity ranking comes with the requirement of human supervision. In this paper, we propose a debiasing framework based on our novel \ul{Se}lf-Guided \ul{B}ias \ul{Ra}nking (\emph{Sebra}), that mitigates biases (spurious correlations) via an automatic ranking of data points by spuriosity within their respective classes. Sebra leverages a key local symmetry in Empirical Risk Minimization (ERM) training -- the ease of learning a sample via ERM inversely correlates with its spuriousity; the fewer spurious correlations a sample exhibits, the harder it is to learn, and vice versa. However, globally across iterations, ERM tends to deviate from this symmetry. Sebra dynamically steers ERM to correct this deviation, facilitating the sequential learning of attributes in increasing order of difficulty, \ie, decreasing order of spuriosity. As a result, the sequence in which Sebra learns samples naturally provides spuriousity rankings. We use the resulting fine-grained bias characterization in a contrastive learning framework to mitigate biases from multiple sources. Extensive experiments show that Sebra consistently outperforms previous state-of-the-art unsupervised debiasing techniques across multiple standard benchmarks, including UrbanCars, BAR, CelebA, and ImageNet-1K. Code, pre-trained models, and training logs are available at https://kadarsh22.github.io/sebra_iclr25/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。