arXiv:2605.10142cs.CVcs.AI2026-05

模型越大,解释越准?实验发现未必。

Scaling Vision Models Does Not Consistently Improve Localisation-Based Explanation Quality

论文配图:Scaling Vision Models Does Not Consistently Improve Localisation-Based Explanation Quality
图 1 · 摘自论文原文
  • 对比11个视觉模型,用5种解释方法评估
  • 深度和参数量增加,解释质量未提升,小模型常更优
  • 预训练不保证更好解释,性能好也可能解释差

人工智能模型不断增大以提升预测准确率,但规模是否提升事后解释质量仍不明确。本文评估了11个计算机视觉模型(包含ResNet、DenseNet和Vision Transformer系列),覆盖不同深度与复杂度,分别从头训练或预训练,在三个含真实分割掩码的图像数据集上进行测试。对每个模型使用五种事后可解释AI方法生成解释,并通过两个定位指标——归因排序准确率(Relevance Rank Accuracy)和新提出的双极精度(Dual-Polarity Precision)——量化掩码对齐程度。结果显示,在多数统计比较中,增加架构深度和参数量并未提升解释质量,小型模型常表现相当甚至更优。尽管预训练通常提高预测性能并增强解释对权重的依赖,却未一致提升定位得分。还发现某些模型预测性能优异,但定位精度接近零,表明仅靠性能指标无法判断预测是否基于标注区域。结论是:模型越大,解释质量不一定越好,因此在安全敏感场景中需显式评估可解释性。

原文摘要 · Abstract (English)

Artificial intelligence models are increasingly scaled to improve predictive accuracy, yet it remains unclear whether scale improves the quality of post-hoc explanations. We investigate this relationship by evaluating 11 computer vision models representing increasing levels of depth and complexity within the ResNet, DenseNet, and Vision Transformer families, trained from scratch or pretrained, across three image datasets with ground-truth segmentation masks. For each model, we generate explanations using five post-hoc explainable AI methods and quantify mask alignment using two localisation metrics: Relevance Rank Accuracy (Arras et al., 2022) and the proposed Dual-Polarity Precision, which measures positive attributions inside the class mask and negative attributions outside it. Across datasets and methods, increasing architectural depth and parameter count does not improve explanation quality in most statistical comparisons, and smaller models often match or exceed deeper variants. While pretraining typically improves predictive performance and increases the dependence of explanations on learned weights, it does not consistently increase localisation scores. We also observe scenarios in which models achieve strong predictive performance while localisation precision is near zero, suggesting that performance metrics alone may not indicate whether predictions are based on the annotated regions. These results indicate that larger models do not reliably provide higher-quality explanations, and that explainability should therefore be assessed explicitly during model selection for safety-sensitive deployments.

可解释AI视觉模型模型评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。