提出FAME方法,用梯度驱动图像修改提升可解释性。
FAME: Feature Activation Map Explanation on Image Classification and Face Recognition
- 结合梯度与扰动思想,用梯度引导图像修改生成注意力图。
- 在图像分类和人脸识别任务中表现优于传统CAM方法。
- 适合需要高精度可解释性的深度学习应用开发者。
深度学习虽大幅提升图像处理精度,但可解释性下降。现有方法如类激活图(CAM)依赖特征图定位重要区域,但其假设在深层网络中不成立。本文提出特征激活图解释方法(FAME),通过梯度驱动方式修改输入图像,而非使用固定补丁扰动。该方法在图像分类与人脸识别任务中均表现出色,定性与定量结果表明其生成的归因图媲美当前最先进系统。代码已开源:https://github.com/AIML-IfI/fame。
原文摘要 · Abstract (English)
Deep Learning has revolutionized machine learning, reaching unprecedented levels of accuracy, but at the cost of reduced interpretability. Especially in image processing systems, deep networks transform local pixel information into more global concepts in a highly obscured manner. Explainable AI methods for image processing try to shed light on this issue by highlighting the regions of the image that are important for the prediction task. Among these, Class Activation Mapping (CAM) and its gradient-based variants compute attributions based on the feature map and upscale them to the image resolution, assuming that feature map locations are influenced only by underlying regions. Perturbation-based methods, such as CorrRISE, on the other hand, try to provide pixel-level attributions by perturbing the input with fixed patches and checking how the output of the network changes. In this work, we propose Feature Activation Map Explanation (FAME), which combines both worlds by using network gradients to compute changes to the input image, manipulating it in a gradient-driven way rather than using fixed patches. We apply this technique on two common tasks, image classification and face recognition, and show that CAM's above-mentioned assumption does not hold for deeper networks. We qualitatively and quantitively show that FAME produces attribution maps that are competitive state-of-the-art systems. Our code is available: {\footnotesize https://github.com/AIML-IfI/fame.}
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。