提出更鲁棒且可解释的原型网络,解决现有方法解释矛盾问题。
A Robust Prototype-Based Network with Interpretable RBF Classifier Foundations
- 基于概率模型改进分类组件法,增强可解释性
- 新模型在多个基准上达顶尖准确率,且具可证明鲁棒性
- 适用于需要高可靠性和透明决策的场景
原型分类学习方法具有内在可解释性,但相比深度模型性能较差。为此发展出深层原型网络(PBNs),又称原型部件模型。本文分析了这些模型在可解释性等方面的表现,聚焦于分类组件(CBC)方法——一种利用概率模型保障可解释性的架构,既可用于浅层也可用于深层。我们发现该方法存在生成矛盾解释等缺陷。基于此,提出改进方案,解决了上述问题,并证明其具备鲁棒性保证,推导出优化鲁棒性的损失函数。进一步分析表明,大多数(深层)PBNs与(深层)RBF分类器相关,因此我们的鲁棒性保证可推广至浅层RBF分类器。实验显示,所提深层PBN在多个基准上达到领先分类精度,同时克服了其他方法的可解释性缺陷;浅层变体则优于其他浅层PBN,兼具内在可解释性与可证明鲁棒性。
原文摘要 · Abstract (English)
Prototype-based classification learning methods are known to be inherently interpretable. However, this paradigm suffers from major limitations compared to deep models, such as lower performance. This led to the development of the so-called deep Prototype-Based Networks (PBNs), also known as prototypical parts models. In this work, we analyze these models with respect to different properties, including interpretability. In particular, we focus on the Classification-by-Components (CBC) approach, which uses a probabilistic model to ensure interpretability and can be used as a shallow or deep architecture. We show that this model has several shortcomings, like creating contradicting explanations. Based on these findings, we propose an extension of CBC that solves these issues. Moreover, we prove that this extension has robustness guarantees and derive a loss that optimizes robustness. Additionally, our analysis shows that most (deep) PBNs are related to (deep) RBF classifiers, which implies that our robustness guarantees generalize to shallow RBF classifiers. The empirical evaluation demonstrates that our deep PBN yields state-of-the-art classification accuracy on different benchmarks while resolving the interpretability shortcomings of other approaches. Further, our shallow PBN variant outperforms other shallow PBNs while being inherently interpretable and exhibiting provable robustness guarantees.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。