arXiv:2505.15246cs.LG2025-05被引 1

通过因果对数扰动消除模型对无关背景的依赖,提升鲁棒性。

Mitigating Spurious Correlations with Causal Logit Perturbation

  • 基于样本级对数扰动生成因果信号,解耦非因果关联。
  • 在四种偏见场景下均达到当前最优性能,准确率提升显著。
  • 适合关注模型可解释性与公平性的研究人员使用。

深度学习在科学、产业和社会领域广泛应用,但部分方法因依赖虚假相关性而缺乏鲁棒性。本文提出一种新型因果对数扰动(Causal Logit Perturbation, CLP)框架,通过扰动网络生成样本级对数扰动,利用样本特征作为输入,并结合人类因果知识进行事实与反事实增强。整个框架采用在线元学习算法优化,在长尾学习、噪声标签学习、广义长尾学习和子群体偏移学习等四类典型偏见场景中均表现出色,持续取得当前最佳性能。可视化结果表明,生成的因果扰动能有效引导模型关注因果图像属性,削弱虚假关联。

原文摘要 · Abstract (English)

Deep learning has seen widespread success in various domains such as science, industry, and society. However, it is acknowledged that certain approaches suffer from non-robustness, relying on spurious correlations for predictions. Addressing these limitations is of paramount importance, necessitating the development of methods that can disentangle spurious correlations. {This study attempts to implement causal models via logit perturbations and introduces a novel Causal Logit Perturbation (CLP) framework to train classifiers with generated causal logit perturbations for individual samples, thereby mitigating the spurious associations between non-causal attributes (i.e., image backgrounds) and classes.} {Our framework employs a} perturbation network to generate sample-wise logit perturbations using a series of training characteristics of samples as inputs. The whole framework is optimized by an online meta-learning-based learning algorithm and leverages human causal knowledge by augmenting metadata in both counterfactual and factual manners. Empirical evaluations on four typical biased learning scenarios, including long-tail learning, noisy label learning, generalized long-tail learning, and subpopulation shift learning, demonstrate that CLP consistently achieves state-of-the-art performance. Moreover, visualization results support the effectiveness of the generated causal perturbations in redirecting model attention towards causal image attributes and dismantling spurious associations.

因果推理模型鲁棒性虚假相关

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。