arXiv:2511.06678cs.CVcs.LG2025-11AAAI被引 1

让模型动态替换概念,无需重训就能适应新知识。

Flexible Concept Bottleneck Model

  • 用超网络根据概念嵌入生成预测权重,支持新概念无缝接入。
  • 引入可学习温度的稀疏max模块,自动挑选最相关概念。
  • 仅需一个轮次微调即可泛化到未见概念,适合快速迭代场景。

概念瓶颈模型(CBM)通过引入人类可理解的概念中间层提升神经网络可解释性。近期研究利用视觉语言模型(VLM)自动化概念选择与标注,但现有基于VLM的CBM在新增概念时通常需要完整重训练,限制了其在真实场景中的适应性,尤其面对快速演进的视觉语言基础模型。为此,我们提出灵活概念瓶颈模型(FCBM),支持动态概念适配,包括完全替换原有概念集。具体地,设计一种超网络,根据概念嵌入生成预测权重,实现新概念的无重训集成;同时引入带可学习温度参数的改进稀疏max模块,动态选择最相关概念,使模型聚焦于最具信息量特征。在五个公开基准上的大量实验表明,本方法在有效概念数量相近的情况下,达到与当前最优基线相当的准确率。此外,仅需单个轮次微调,模型即可良好泛化至未见概念,展现出强适应性与灵活性。

原文摘要 · Abstract (English)

Concept bottleneck models (CBMs) improve neural network interpretability by introducing an intermediate layer that maps human-understandable concepts to predictions. Recent work has explored the use of vision-language models (VLMs) to automate concept selection and annotation. However, existing VLM-based CBMs typically require full model retraining when new concepts are involved, which limits their adaptability and flexibility in real-world scenarios, especially considering the rapid evolution of vision-language foundation models. To address these issues, we propose Flexible Concept Bottleneck Model (FCBM), which supports dynamic concept adaptation, including complete replacement of the original concept set. Specifically, we design a hypernetwork that generates prediction weights based on concept embeddings, allowing seamless integration of new concepts without retraining the entire model. In addition, we introduce a modified sparsemax module with a learnable temperature parameter that dynamically selects the most relevant concepts, enabling the model to focus on the most informative features. Extensive experiments on five public benchmarks demonstrate that our method achieves accuracy comparable to state-of-the-art baselines with a similar number of effective concepts. Moreover, the model generalizes well to unseen concepts with just a single epoch of fine-tuning, demonstrating its strong adaptability and flexibility.

可解释性概念瓶颈动态适配视觉语言模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。