用更可靠的特征归因引导模型,减少对错误线索的依赖。
Model Guidance via Robust Feature Attribution
- 设计新目标函数,同时提升解释鲁棒性与抗捷径学习能力。
- 实验显示测试误分类率降低20%,优于当前最优方法。
- 揭示标注质量比数量更重要,适合医疗与NLP领域研究者。
控制模型学习的模式对于防止其依赖无关或误导性特征至关重要。这种对无关特征的依赖(常称为捷径特征)已在医学影像和自然语言处理等多个领域被观察到,可能引发实际危害。现有缓解策略通常依赖人类或机器提供的特征相关性标注,将其与模型解释(如特征显著性)对比,并用于训练时优化损失函数。然而,近期研究表明,特征显著性方法不可靠,难以提供有效信号。本文提出一种简化目标函数,同时优化解释鲁棒性与捷径学习缓解效果。理论上证明该方法更具有效性。在一系列全面实验中,该方法相比现有最优方法将测试时误分类率降低20%。实验还扩展至自然语言处理任务,并进行新颖消融分析,揭示标注质量的重要性高于数量。代码已公开于:https://github.com/Mihneaghitu/ModelGuidanceViaRobustFeatureAttribution。
原文摘要 · Abstract (English)
Controlling the patterns a model learns is essential to preventing reliance on irrelevant or misleading features. Such reliance on irrelevant features, often called shortcut features, has been observed across domains, including medical imaging and natural language processing, where it may lead to real-world harms. A common mitigation strategy leverages annotations (provided by humans or machines) indicating which features are relevant or irrelevant. These annotations are compared to model explanations, typically in the form of feature salience, and used to guide the loss function during training. Unfortunately, recent works have demonstrated that feature salience methods are unreliable and therefore offer a poor signal to optimize. In this work, we propose a simplified objective that simultaneously optimizes for explanation robustness and mitigation of shortcut learning. Unlike prior objectives with similar aims, we demonstrate theoretically why our approach ought to be more effective. Across a comprehensive series of experiments, we show that our approach consistently reduces test-time misclassifications by 20% compared to state-of-the-art methods. We also extend prior experimental settings to include natural language processing tasks. Additionally, we conduct novel ablations that yield practical insights, including the relative importance of annotation quality over quantity. Code for our method and experiments is available at: https://github.com/Mihneaghitu/ModelGuidanceViaRobustFeatureAttribution.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。