通过噪声正则化让模型忽略数据中的虚假关联,提升跨域泛化能力。
Shortcut Invariance: Targeted Jacobian Regularization in Disentangled Latent Space
- 在解耦潜在空间中识别与标签强相关的虚假特征轴,注入定向噪声抑制其影响。
- 在多个基准上实现当前最优的跨分布性能,无需虚假关联标签或冲突样本。
- 保留完整表征同时增强对关键特征的鲁棒性,适合医疗影像等复杂场景。
深度神经网络容易学习到训练数据中的捷径(虚假相关),损害其在分布外数据上的泛化能力。以往方法多通过输入空间重加权缓解此问题,依赖显式捷径标签或基于每样本损失的启发式推断,且通常假设训练集中存在捷径冲突样本,这一假设在医学影像等多中心数据中常不成立。本文提出一种潜在空间方法,将捷径学习视为对捷径对齐轴的过度依赖。在解耦潜在空间中,通过标签相关性识别候选捷径轴,并在训练中注入定向各向异性噪声,降低分类器对这些轴的敏感度。不同于移除、投影或对抗性抑制捷径特征的方法,本方法保留完整表示,通过正则化分类器沿这些轴的雅可比矩阵和曲率,实现功能不变性。实验表明,该方法在标准捷径学习基准上达到当前最优的跨分布性能,且无需捷径标签或捷径冲突样本。
原文摘要 · Abstract (English)
Deep neural networks are prone to learning shortcuts, spurious correlations present in the training data that undermine out-of-distribution (OOD) generalization. Most prior work mitigates shortcut learning through input-space reweighting, either relying on explicit shortcut labels or inferring shortcut structure from heuristics such as per-sample loss. Moreover, these approaches typically assume the presence of some shortcut-conflicting examples in the training set, an assumption that is often violated in practice, particularly in medical imaging where data is aggregated across institutions with different acquisition protocols. We propose a latent-space method that views shortcut learning as over-reliance on shortcut-aligned axes. In a disentangled latent space, we identify candidate shortcut-aligned axes via their strong correlation with labels and reduce classifier reliance on them by injecting targeted anisotropic noise during training. Unlike prior latent-space based approaches that remove, project out, or adversarially suppress shortcut features, our method preserves the full representation and instead impose functional invariance by regularizing the classifier's sensitivity along those axes. We show that injecting anisotropic noise induces targeted Jacobian and curvature regularization, effectively flattening the decision boundary along shortcut axes while leaving core feature dimensions largely unaffected. Our method achieves state-of-the-art OOD performance across standard shortcut-learning benchmarks without requiring shortcut labels or shortcut-conflicting samples.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。