提出可逻辑推理的透明模型,让预测既准确又可解释。
Neural Probabilistic Circuits: Enabling Compositional and Interpretable Predictions through Logical Reasoning
- 用属性识别+概率电路结构实现可组合的逻辑推理
- 在4个数据集上性能媲美黑盒模型,且误差有理论上限
- 提供最可能解释和反事实解释,适合需要透明决策的场景
端到端深度神经网络虽在多个领域表现卓越,但常因缺乏可解释性受到批评。现有事后解释方法难以准确反映黑箱模型,常导致误导性或不完整解释。为此,我们提出一种内在透明的模型架构——神经概率电路(NPC),通过逻辑推理实现可组合且可解释的预测。NPC由两个模块构成:属性识别模型,用于预测各类属性的概率;基于概率电路的任务预测器,可在识别出的属性上进行逻辑推理以做出分类判断。为训练NPC,我们设计了三阶段算法:属性识别、电路构建与联合优化。理论上,我们证明了NPC的误差可被其各模块误差的线性组合上界控制。为进一步展示可解释性,我们提供了最可能解释和反事实解释。在四个基准数据集上的实验表明,NPC在可解释性与性能之间取得良好平衡,其性能甚至可媲美端到端黑盒模型。
原文摘要 · Abstract (English)
End-to-end deep neural networks have achieved remarkable success across various domains but are often criticized for their lack of interpretability. While post hoc explanation methods attempt to address this issue, they often fail to accurately represent these black-box models, resulting in misleading or incomplete explanations. To overcome these challenges, we propose an inherently transparent model architecture called Neural Probabilistic Circuits (NPCs), which enable compositional and interpretable predictions through logical reasoning. In particular, an NPC consists of two modules: an attribute recognition model, which predicts probabilities for various attributes, and a task predictor built on a probabilistic circuit, which enables logical reasoning over recognized attributes to make class predictions. To train NPCs, we introduce a three-stage training algorithm comprising attribute recognition, circuit construction, and joint optimization. Moreover, we theoretically demonstrate that an NPC's error is upper-bounded by a linear combination of the errors from its modules. To further demonstrate the interpretability of NPC, we provide both the most probable explanations and the counterfactual explanations. Empirical results on four benchmark datasets show that NPCs strike a balance between interpretability and performance, achieving results competitive even with those of end-to-end black-box models while providing enhanced interpretability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。