用几何方法防止原型坍缩,让模型解释更可靠
This Looks Distinctly Like That: Grounding Interpretable Recognition in Stiefel Geometry against Neural Collapse
- 在施蒂费尔流形上用正交基表示原型,从结构上避免坍缩
- 在细粒度数据集上准确率达新高,因果忠实性提升显著
- 适合需要可解释性的医疗、工业检测等关键场景
原型网络提供基于案例的解释机制,但常因原型坍缩(多个原型退化为高度冗余证据)而丧失可解释性。我们将其归因于神经坍缩的终端动态:交叉熵优化抑制类内方差,使类别特征趋向低维极限。为此提出自适应流形原型(AMP)框架,利用施蒂费尔流形上的黎曼优化,将类别原型表示为正交基,从构造上使秩一坍缩不可行。AMP还通过非负容量向量的邻近梯度更新学习类别特定有效秩,并引入空间正则化减少旋转歧义,促进局部化、非重叠的部分证据。在细粒度基准测试中,AMP实现最先进的分类准确率,同时显著提升与先验可解释模型相比的因果忠实性。
原文摘要 · Abstract (English)
Prototype networks provide an intrinsic case based explanation mechanism, but their interpretability is often undermined by prototype collapse, where multiple prototypes degenerate to highly redundant evidence. We attribute this failure mode to the terminal dynamics of Neural Collapse, where cross entropy optimization suppresses intra class variance and drives class conditional features toward a low dimensional limit. To mitigate this, we propose Adaptive Manifold Prototypes (AMP), a framework that leverages Riemannian optimization on the Stiefel manifold to represent class prototypes as orthonormal bases and make rank one prototype collapse infeasible by construction. AMP further learns class specific effective rank via a proximal gradient update on a nonnegative capacity vector, and introduces spatial regularizers that reduce rotational ambiguity and encourage localized, non overlapping part evidence. Extensive experiments on fine-grained benchmarks demonstrate that AMP achieves state-of-the-art classification accuracy while significantly improving causal faithfulness over prior interpretable models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。