arXiv:2605.06440cs.LGcs.CV2026-05

用双曲空间建模概念层级,让模型更懂语义结构。

Hyperbolic Concept Bottleneck Models

论文配图:Hyperbolic Concept Bottleneck Models
图 1 · 摘自论文原文
  • 将概念嵌入双曲空间,利用几何包含关系表达语义层次。
  • 无需额外监督,在稀疏数据下性能媲美20倍数据的欧氏模型。
  • 适合需要可解释性和层次一致性的高阶视觉任务场景。

概念瓶颈模型(CBMs)通过限制分类器输入为人类可理解的概念,提升神经网络的可解释性。然而现有模型在平坦的欧几里得空间中处理概念,将其视为独立正交维度,忽略了概念间固有的语义层次结构。为此,我们提出双曲概念瓶颈模型(HypCBM),一种后处理框架,将瓶颈层置于双曲空间中,以非对称几何包含关系重构概念激活机制。我们发现蕴含锥(entailment cone)不仅是预训练惩罚项,更是一种自然的测试时激活信号:概念蕴含锥内的包含裕度可生成稀疏且层次感知的激活,无需额外监督或学习模块。此外,我们引入自适应缩放律,实现层次忠实的干预传播,使用户修正能一致地沿概念树传递。实验证明,HypCBM在稀疏场景下性能媲美训练数据量20倍于其的后处理欧氏模型,具有更强的层次一致性与对抗输入扰动的鲁棒性。

原文摘要 · Abstract (English)

Concept Bottleneck Models (CBMs) have become a popular approach to enable interpretability in neural networks by constraining classifier inputs to a set of human-understandable concepts. While effective, current models embed concepts in flat Euclidean space, treating them as independent, orthogonal dimensions. Concepts, however, are highly structured and organized in semantic hierarchies. To resolve this mismatch, we propose Hyperbolic Concept Bottleneck Models (HypCBM), a post-hoc framework that grounds the bottleneck in this structure by reformulating concept activation as asymmetric geometric containment in hyperbolic space. Rather than treating entailment cones as a pre-training penalty, we show they encode a natural test-time activation signal: the margin of inclusion within a concept's entailment cone yields sparse, hierarchy-aware activations without any additional supervision or learned modules. We further introduce an adaptive scaling law for hierarchically faithful interventions, propagating user corrections coherently through the concept tree. Empirically, HypCBM rivals post-hoc Euclidean models trained on 20$\times$ more data in sparse regimes required for human interpretability, with stronger hierarchical consistency and improved robustness to input corruptions.

可解释性双曲空间概念瓶颈

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。