通过遮蔽图像补全,揭示模型学到了什么结构
Fill in the blanks: Rethinking Interpretability in vision
- 用遮蔽图像补全任务探测模型学到的输入结构
- 在多个数据集上发现一致的补全模式
- 无需修改模型,可通用集成到主流平台
模型可解释性仍是当前顶尖深度学习模型面临的关键挑战。尤其在医疗影像等专业领域,视觉模型需具备可解释能力以推动应用落地。尽管可解释AI(XAI)早期为卷积神经网络开发了解释方法,但近年研究多集中于通过显著性图分配属性,仅能提供样本级解释,且跨模型适应性差。本文提出新视角:探究模型在训练中习得的通用输入结构,核心问题是‘视觉模型如何补全被遮蔽的图像’。在标准视觉数据集和预训练模型上的实验显示,模型表现出一致的补全模式,该方法可作为无需修改模型的通用可解释性工具,集成至现代机器学习平台。代码已开源。
原文摘要 · Abstract (English)
Model interpretability is a key challenge that has yet to align with the advancements observed in contemporary state-of-the-art deep learning models. In particular, deep learning aided vision tasks require interpretability, in order for their adoption in more specialized domains such as medical imaging. Although the field of explainable AI (XAI) developed methods for interpreting vision models along with early convolutional neural networks, recent XAI research has mainly focused on assigning attributes via saliency maps. As such, these methods are restricted to providing explanations at a sample level, and many explainability methods suffer from low adaptability across a wide range of vision models. In our work, we re-think vision-model explainability from a novel perspective, to probe the general input structure that a model has learnt during its training. To this end, we ask the question: "How would a vision model fill-in a masked-image". Experiments on standard vision datasets and pre-trained models reveal consistent patterns, and could be intergrated as an additional model-agnostic explainability tool in modern machine-learning platforms. The code will be available at \url{https://github.com/BoTZ-TND/FillingTheBlanks.git}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。