用逻辑运算提升概念模型表达力,让AI推理更准确可解释。
LogicCBMs: Logic-Enhanced Concept-Based Learning
- 引入可微逻辑模块,用逻辑运算连接概念
- 在多个数据集上准确率更高,干预效果显著
- 适合需要透明决策过程的场景,如医疗诊断
概念瓶颈模型(CBMs)为神经网络提供了语义抽象的基础,但传统方法仅依赖概念的线性加权组合,表达能力受限。本文提出逻辑增强型概念学习模型(LogicCBM),通过设计可微逻辑模块,将CBM学习到的概念通过逻辑运算(如与、或、非)进行组合,使模型能捕捉概念间的复杂关系,同时保持端到端可训练性。该方法显著提升了模型的表达能力与推理能力。在多个知名基准和合成数据集上的实验表明,LogicCBM不仅预测准确率更高,还能有效执行概念干预,并保持高度可解释性。
原文摘要 · Abstract (English)
Concept Bottleneck Models (CBMs) provide a basis for semantic abstractions within a neural network architecture. Such models have primarily been seen through the lens of interpretability so far, wherein they offer transparency by inferring predictions as a linear combination of semantic concepts. However, a linear combination is inherently limiting. So we propose the enhancement of concept-based learning models through propositional logic. We introduce a logic module that is carefully designed to connect the learned concepts from CBMs through differentiable logic operations, such that our proposed LogicCBM can go beyond simple weighted combinations of concepts to leverage various logical operations to yield the final predictions, while maintaining end-to-end learnability. Composing concepts using a set of logic operators enables the model to capture inter-concept relations, while simultaneously improving the expressivity of the model in terms of logic operations. Our empirical studies on well-known benchmarks and synthetic datasets demonstrate that these models have better accuracy, perform effective interventions and are highly interpretable.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。