通过分离核心与虚假特征学习,用新评分方法筛选关键样本以减少偏见。
Mitigating Spurious Correlations with Memorization-Guided Dataset De-Biasing

- 设计双阶段评分机制,区分核心特征与虚假特征的学习难度。
- 仅用10%原始数据训练,模型性能超越现有去偏方法。
- 无需群体标签,适合数据偏见严重但标签缺失的场景。
真实世界数据集常包含与目标标签无因果关系的虚假相关性。当这些相关性主导多数训练样本时,模型会依赖它们,导致不具相同虚假模式的少数样本被误分类。尽管可通过选择子集来更好代表少数样本,但该方法通常需访问群体标签,而这类标签往往未知。此外,我们发现现有不变子集或核心集选择中的样本评分函数大多依赖虚假特征,因而无法准确捕捉核心、因果相关特征的重要性或难易度。为此,我们提出一种两阶段样本评分函数,解耦核心与虚假特征的学习动态,并分别评估其难度。基于该指标,我们设计新算法,优先选取具有和不具有虚假相关性的信息量样本。大量实验表明,使用所选样本训练的标准ERM模型性能优于当前最优去偏技术,且仅需原始数据的10%。
原文摘要 · Abstract (English)
Real-world datasets often contain spurious correlations that are not causally related to the target label. When such correlations dominate the majority of training samples, models tend to rely on them, leading to misclassification of minority samples that do not exhibit the same spurious patterns. While a potential approach is to select subsets of data to better represent the minority samples, this may require access to group labels, which are typically unknown. Furthermore, as we demonstrate, widely used sample scoring functions in the invariant subset or coreset selection literature largely depend on spurious features and therefore fail to accurately capture the importance or difficulty of core, causally relevant features. Accordingly, we propose to mitigate spurious correlations by developing a two-stage sample scoring function that disentangles the learning dynamics of core and spurious features and evaluates their difficulty separately. Based on our proposed metric, we introduce a new algorithm to find and prioritize informative samples both with and without spurious correlations. Extensive experiments demonstrate that a standard ERM model trained on our selected samples achieves superior performance compared to state-of-the-art debiasing techniques, while requiring as little as 10\% of the original training data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。