用相似性解释图像分类,让模型决策透明可懂。
SIC: Similarity-Based Interpretable Image Classification with Neural Networks
- 基于案例推理,提取类代表特征向量作判断依据。
- 在斯坦福狗、趣味鸟等数据集上准确率媲美顶尖模型。
- 提供像素级解释,适合医疗等高可靠性场景。
深度学习在关键领域部署需兼顾高精度与可解释性。我们提出SIC,一种内在可解释的神经网络,能提供局部和全局决策解释。基于案例推理思想,SIC从训练图像中提取类代表支持向量,保留相关特征并抑制无关信息。分类通过计算输入隐层特征向量与这些支持向量的相似度并聚合得出。采用B-Cos变换,使模型权重与输入对齐,生成一致的像素级解释,同时提供案例推理的全局解释。我们在三个任务上评估:斯坦福狗和FunnyBirds细粒度分类、Pascal VOC多标签分类、RSNA病理检测。结果表明,SIC不仅在准确率上媲美最先进黑箱及可解释模型,且其解释经实践验证具有洞察力。理论分析证明解释满足解释性公理。研究凸显SIC在需理解决策过程的应用中的潜力。
原文摘要 · Abstract (English)
The deployment of deep learning models in critical domains necessitates a balance between high accuracy and interpretability. We introduce SIC, an inherently interpretable neural network that provides local and global explanations of its decision-making process. Leveraging the concept of case-based reasoning, SIC extracts class-representative support vectors from training images, ensuring they capture relevant features while suppressing irrelevant ones. Classification decisions are made by calculating and aggregating similarity scores between these support vectors and the input's latent feature vector. We employ B-Cos transformations, which align model weights with inputs, to yield coherent pixel-level explanations in addition to global explanations of case-based reasoning. We evaluate SIC on three tasks: fine-grained classification on Stanford Dogs and FunnyBirds, multi-label classification on Pascal VOC, and pathology detection on the RSNA dataset. Results indicate that SIC not only achieves competitive accuracy compared to state-of-the-art black-box and inherently interpretable models but also offers insightful explanations verified through practical evaluation on the FunnyBirds benchmark. Our theoretical analysis proves that these explanations fulfill established axioms for explanations. Our findings underscore SIC's potential for applications where understanding model decisions is as critical as the decisions themselves.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。