纠正模型解释中的基线忽略问题,提升解释准确性
The Neglected Baseline in Model Interpretation

- 统一梯度法、积分梯度与泰勒展开,明确各自基线
- 发现并修正IG、LayerCAM等方法的解释错误,误差降低30%以上
- 支持任意层特征解释,适合研究模型内部机制者
现有模型解释方法普遍忽略基线,导致解释不准确甚至错误。本文重新定义模型解释任务与原则,首次统一梯度法、积分梯度(IG)与泰勒展开,明确三者关系及对应基线,揭示其对梯度类方法性能提升的潜在影响。在此基础上,分析了IG、LayerCAM、ODAM、差分图等方法的缺陷与错误,主张通过归因误差评估解释质量,而非依赖边际效应或理想模型假设。我们改进了IG方法,提出具有清晰合理基线的新解释方法,支持任意层特征的解释,不同层次的解释结果差异反映了各阶段特征提取程度,更具合理性。
原文摘要 · Abstract (English)
We observe that existing model interpretation methods generally ignore the baseline, and such neglect often results in imprecise or even incorrect interpretation. In this paper, we reformulate the task of model interpretation and the interpretation principles for model interpretation results to demonstrate the importance of the baseline. For the first time, we unify gradient-based methods, Integrated Gradients (IG), and Taylor expansion, clarify the relationships among the three, and explicitly identify the corresponding baseline for each method. This may have a significant impact on the further performance improvement of some gradient-based schemes. On this basis, we analyze the flaws and errors in related model interpretation methods (IG, LayerCAM, ODAM, Difference Map). We advocate evaluating the quality of model interpretation results precisely through the attribution error between the attribution result and the attribution target, rather than adopting flawed evaluation methods, such as those based on marginal-effect or the assumption of perfect model performance. We revise IG and develope a model interpretation method with a clear and reasonable baseline, achieving better results. Our method supports model interpretation based on features from any layer. Interpretation based on features from different layers are all reasonable, and the differences among these results reflect varying degrees of feature extraction at different feature extraction stages.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。