arXiv:2506.05014cs.LGcs.AI2025-06被引 3

让模型显式学习概念间关系,提升可解释性与鲁棒性。

Towards Reasonable Concept Bottleneck Models

  • 通过架构编码概念间互斥、层级等复杂关系,灵活支持先验知识注入。
  • 在概念缺失时仍保持黑盒级性能,且避免概念泄露。
  • 侧通道机制帮助有限概念场景下保持效果,适合需要可解释性的应用。

我们提出一种新颖、灵活且高效的概念瓶颈模型(CBM)设计框架,使实践者能够显式编码和扩展对概念-概念(C-C)及概念-任务(C→Y)关系的先验知识。由此生成的C-REASONING-MODEL(CREAM)可架构化地表达任意类型的C-C关系,如互斥、层级关联或相关性,以及潜在稀疏的C→Y关系。此外,CREAM可选引入正则化侧通道,以补充可能不完整的概念集,在保持竞争性任务性能的同时,鼓励预测基于概念。为评估此类设定下的CBM,我们引入一个不依赖于C→Y关系的可解释性度量。实验表明,无需额外计算开销,CREAM支持高效干预,避免概念泄露,并在概念缺失时达到黑盒级性能。我们进一步分析了侧通道对可解释性和可干预性的影响。重要的是,侧通道使CBM在仅有限概念可用时仍具有效性。

原文摘要 · Abstract (English)

We propose a novel, flexible, and efficient framework for designing Concept Bottleneck Models (CBMs) that enables practitioners to explicitly encode and extend their prior knowledge and beliefs about the concept-concept ($C-C$) and concept-task ($C \to Y$) relationships within the model's reasoning when making predictions. The resulting $\textbf{C}$oncept $\textbf{REA}$soning $\textbf{M}$odels (CREAMs) architecturally encode arbitrary types of $C-C$ relationships such as mutual exclusivity, hierarchical associations, and/or correlations, as well as potentially sparse $C \to Y$ relationships. Moreover, CREAM can optionally incorporate a regularized side-channel to complement the potentially {incomplete concept sets}, achieving competitive task performance while encouraging predictions to be concept-grounded. To evaluate CBMs in such settings, we introduce a $C \to Y$ agnostic metric that quantifies interpretability when predictions partially rely on the side-channel. In our experiments, we show that, without additional computational overhead, CREAM models support efficient interventions, can avoid concept leakage, and achieve black-box-level performance under missing concepts. We further analyze how an optional side-channel affects interpretability and intervenability. Importantly, the side-channel enables CBMs to remain effective even in scenarios where only a limited number of concepts are available.

可解释性概念瓶颈模型架构侧通道

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。