arXiv:2606.19489cs.LGcs.AI2026-06被引 1

用分层决策树提升概念模型的可解释性,防止信息泄露。

Concept Flow Models: Anchoring Concept-Based Reasoning with Hierarchical Bottlenecks

论文配图:Concept Flow Models: Anchoring Concept-Based Reasoning with Hierarchical Bottlenecks
图 1 · 摘自论文原文
  • 用分层决策树替代扁平瓶颈,逐级聚焦关键概念。
  • 在多个数据集上保持与传统模型相当的准确率。
  • 推理过程透明可审计,适合需要可解释性的场景。

概念瓶颈模型(CBMs)通过将学习特征映射到人类可理解的概念空间来提升可解释性。近期方法利用视觉-语言模型生成概念嵌入,减少人工标注需求。但此类模型存在关键局限:当概念数量接近嵌入维度时,信息泄露加剧,导致模型利用虚假或语义无关相关性,削弱可解释性。本文提出概念流模型(CFMs),以分层、概念驱动的决策树取代扁平瓶颈。树中每个内部节点聚焦一组局部判别性概念,逐步缩小预测范围。框架从视觉嵌入构建决策层级,在每层分布语义概念,并通过概率路径遍历训练可微概念权重。大量实验表明,CFMs在多个基准测试上达到与平坦CBMs相当的预测性能,同时显著降低信息泄露,有效概念使用量减少。此外,CFMs生成逐步决策流,支持透明且可审计的模型推理,具备层次化类别结构。

原文摘要 · Abstract (English)

Concept Bottleneck Models (CBMs) enhance interpretability by projecting learned features into a human-understandable concept space. Recent approaches leverage vision-language models to generate concept embeddings, reducing the need for manual concept annotations. However, these models suffer from a critical limitation: as the number of concepts approaches the embedding dimension, information leakage increases, enabling the model to exploit spurious or semantically irrelevant correlations and undermining interpretability. In this work, we propose Concept Flow Models (CFMs), which replace the flat bottleneck with a hierarchical, concept-driven decision tree. Each internal node in the hierarchy focuses on a localized subset of discriminative concepts, progressively narrowing the prediction scope. Our framework constructs decision hierarchies from visual embeddings, distributes semantic concepts at each hierarchy level, and trains differentiable concept weights through probabilistic tree traversal. Extensive experiments on diverse benchmarks demonstrate that CFMs match the predictive performance of flat CBMs, while substantially mitigating information leakage by reducing effective concept usage. Furthermore, CFMs yield stepwise decision flows that enable transparent and auditable model reasoning with hierarchical class structures.

可解释性概念模型决策树视觉推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。