让模型按需调用不同粒度概念,降低专家干预成本。
Matryoshka Concept Bottleneck Models

- 将概念分层嵌套,实现单模型多粒度推理
- 干预成本从线性降为对数级,性能逐级提升
- 适合需要灵活解释的医疗、金融等高可信场景
概念瓶颈模型(CBMs)是可解释深度学习的重要范式,通过人类可理解的概念进行预测。但其实际部署受限于测试时干预成本过高——修正错误通常需专家人工检查大量预测概念。现有方法存在根本缺陷:要么使用单一静态概念集,迫使专家全面标注,导致干预成本高昂;要么为不同概念预算训练多个模型,带来巨大计算与维护开销。为此,我们提出马特罗什卡概念瓶颈模型(MCBM),一种统一架构,支持单模型内自适应概念使用。受马特罗什卡表示学习启发,MCBM根据最大相关性与最小冗余组织概念层级,实现无需重训的多粒度推理。理论上,MCBM将期望干预成本从线性降至对数级 $O(\log K)$,同时保证性能单调提升。实验表明,MCBM在性能上媲美独立训练的模型,同时支持动态高效的人机协作。
原文摘要 · Abstract (English)
Concept Bottleneck Models (CBMs) have emerged as a prominent paradigm for interpretable deep learning, learning by grounding predictions in human-understandable concepts. However, their practical deployment is hindered by the high cost of test-time intervention, as correcting model errors typically requires human experts to manually inspect and verify a large set of predicted concepts. Existing approaches suffer from a fundamental structural limitation: they either adopt a single static concept set, forcing experts to exhaustively annotate concepts and incurring prohibitive intervention costs, or train multiple models tailored to different concept budgets, resulting in substantial computational and maintenance overhead. To address this challenge, we propose the Matryoshka Concept Bottleneck Model (MCBM), a unified architecture that enables adaptive concept utilization within a single model. Inspired by Matryoshka Representation Learning, MCBM organizes concepts into a nested hierarchy based on maximum relevance and minimum redundancy, allowing inference at multiple levels of conceptual granularity without retraining. Theoretically, we show that MCBM reduces the expected intervention costs from linear to logarithmic order, $O(\log K)$, while guaranteeing monotonic performance improvement. Empirically, extensive experiments demonstrate that MCBM matches the performance of independently trained models while enabling dynamic and efficient expert interaction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。