arXiv:2505.13910cs.LG2025-05IJCAI被引 4

无需人工标注分组标签,自动发现模型预测捷径并提升鲁棒性

ShortcutProbe: Probing Prediction Shortcuts for Learning Robust Models

  • 通过分析模型隐空间识别预测捷径,定位非鲁棒依赖特征
  • 在多个数据集上显著提升模型对虚假关联的鲁棒性
  • 适用于无标注场景,尤其适合捕捉细微像素级偏差

深度学习模型常因无意中学习到目标与非必要特征间的虚假相关而表现不佳,例如图像分类器可能依赖与物体无关的背景进行判断。这种现象称为虚假偏倚,会严重降低模型在缺乏已学虚假相关性的数据上的性能。现有缓解方法通常需要带有虚假相关性标注的多组数据(即组标签),但这类标注成本高昂,且难以捕捉如依赖特定像素等细微虚假偏倚。本文提出一种无需组标签的后处理虚假偏倚缓解框架ShortcutProbe,该框架通过分析模型隐空间中的表示,识别反映潜在非鲁棒性的预测捷径,并重新训练模型使其对这些捷径保持不变,从而增强鲁棒性。我们从理论上分析了框架有效性,并在多个数据集上实证表明其是提升模型对虚假偏倚鲁棒性的高效实用工具。

原文摘要 · Abstract (English)

Deep learning models often achieve high performance by inadvertently learning spurious correlations between targets and non-essential features. For example, an image classifier may identify an object via its background that spuriously correlates with it. This prediction behavior, known as spurious bias, severely degrades model performance on data that lacks the learned spurious correlations. Existing methods on spurious bias mitigation typically require a variety of data groups with spurious correlation annotations called group labels. However, group labels require costly human annotations and often fail to capture subtle spurious biases such as relying on specific pixels for predictions. In this paper, we propose a novel post hoc spurious bias mitigation framework without requiring group labels. Our framework, termed ShortcutProbe, identifies prediction shortcuts that reflect potential non-robustness in predictions in a given model's latent space. The model is then retrained to be invariant to the identified prediction shortcuts for improved robustness. We theoretically analyze the effectiveness of the framework and empirically demonstrate that it is an efficient and practical tool for improving a model's robustness to spurious bias on diverse datasets.

虚假偏倚模型鲁棒性后处理无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。