构建分层概念模型,自动发现细粒度概念并支持多层级解释。
Hierarchical Concept-based Interpretable Models
- 用分层结构显式建模概念间关系,提升可解释性。
- 无需额外标注即可从预训练模型中挖掘出人类可懂的子概念。
- 支持不同粒度的概念干预,显著提升任务准确率,适合模型调试与去偏。
现代深度神经网络因潜在表示不透明而难以解释,阻碍了模型理解、调试和去偏。概念嵌入模型(CEMs)通过将输入映射到人类可理解的概念表示来解决此问题,但其无法表达概念间关系,且需在不同粒度下提供概念标注,限制了应用范围。本文提出分层概念嵌入模型(HiCEMs),通过层次结构显式建模概念间关系。为实现在真实场景中的应用,我们提出概念拆分(Concept Splitting)方法,无需额外标注即可从预训练CEM的嵌入空间中自动发现更细粒度的子概念。这使得HiCEMs能在有限概念标签下生成细粒度解释,降低标注负担。在多个数据集上的评估,包括用户研究及在新提出的3D厨房渲染数据集PseudoKitchens上的实验表明:(1) 概念拆分能发现训练时未包含的人类可理解子概念,用于训练高精度的HiCEMs;(2) HiCEMs支持测试时在不同粒度进行概念干预,显著提升任务准确率。
原文摘要 · Abstract (English)
Modern deep neural networks remain challenging to interpret due to the opacity of their latent representations, impeding model understanding, debugging, and debiasing. Concept Embedding Models (CEMs) address this by mapping inputs to human-interpretable concept representations from which tasks can be predicted. Yet, CEMs fail to represent inter-concept relationships and require concept annotations at different granularities during training, limiting their applicability. In this paper, we introduce Hierarchical Concept Embedding Models (HiCEMs), a new family of CEMs that explicitly model concept relationships through hierarchical structures. To enable HiCEMs in real-world settings, we propose Concept Splitting, a method for automatically discovering finer-grained sub-concepts from a pretrained CEM's embedding space without requiring additional annotations. This allows HiCEMs to generate fine-grained explanations from limited concept labels, reducing annotation burdens. Our evaluation across multiple datasets, including a user study and experiments on PseudoKitchens, a newly proposed concept-based dataset of 3D kitchen renders, demonstrates that (1) Concept Splitting discovers human-interpretable sub-concepts absent during training that can be used to train highly accurate HiCEMs, and (2) HiCEMs enable powerful test-time concept interventions at different granularities, leading to improved task accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。