arXiv:2501.14182cs.CV2025-01被引 1

只改一个权重,就能事后消除模型对虚假特征的依赖。

Single-weight Model Editing for Post-hoc Spurious Correlation Neutralization

论文配图:Single-weight Model Editing for Post-hoc Spurious Correlation Neutralization
图 1 · 摘自论文原文
  • 将虚假特征视为虚构类别,通过单权重修改实现精准移除。
  • 仅修改一个权重即可有效中和虚假相关性,其他类别性能几乎不变。
  • 适合部署后修复模型误判,无需重新训练,实用性强。

神经网络训练常依赖简单特征作为捷径以最小化损失,但这些特征可能与目标标签存在虚假相关,导致错误预测。现有方法多在训练阶段抑制虚假相关,不仅增加训练成本,且难以应对模型上线后才发现的问题。此外,虚假性本身具有主观性。关键问题在于:特征虚假程度如何量化?如何按比例削弱模型对其关注以保证可靠预测?为此,我们提出一种事后中和虚假特征影响的方法,可任意程度控制。将虚假特征视为原类别内的虚构子类,通过类别移除策略消除。提出一种独特的精确类别移除技术,仅需单权重修改,对其他类别性能影响极小。大量实验表明,仅通过后处理修改一个权重,本方法即能达到或超越当前最佳方法的性能。

原文摘要 · Abstract (English)

Neural network training tends to exploit the simplest features as shortcuts to greedily minimize training loss. However, some of these features might be spuriously correlated with the target labels, leading to incorrect predictions by the model. Several methods have been proposed to address this issue. Focusing on suppressing the spurious correlations with model training, they not only incur additional training cost, but also have limited practical utility as the model misbehavior due to spurious relations is usually discovered after its deployment. It is also often overlooked that spuriousness is a subjective notion. Hence, the precise questions that must be investigated are; to what degree a feature is spurious, and how we can proportionally distract the model's attention from it for reliable prediction. To this end, we propose a method that enables post-hoc neutralization of spurious feature impact, controllable to an arbitrary degree. We conceptualize spurious features as fictitious sub-classes within the original classes, which can be eliminated by a class removal scheme. We then propose a unique precise class removal technique that makes a single-weight modification, which entails negligible performance compromise for the remaining classes. We perform extensive experiments, demonstrating that by editing just a single weight in a post-hoc manner, our method achieves highly competitive, or better performance against the state-of-the-art methods.

模型编辑虚假相关后处理权重修改

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。