让神经网络推理更可信:引入因果关系的可干预模型
Causal Neural Probabilistic Circuits
- 用因果图构建概率电路,支持精确因果推断
- 干预时能自动调整相关概念,提升预测准确率10%以上
- 适合需要可解释性与专家干预的医疗、金融场景
概念瓶颈模型(CBMs)通过引入概念层提升端到端神经网络的可解释性,支持对概念值进行干预以提高分类准确率。但传统方法仅替换被纠正的概念值,忽略概念间的因果依赖。为此,我们提出因果神经概率电路(CNPC),结合神经属性预测器与基于因果图编译的概率电路。该电路支持精确、高效的因果推断,天然尊重概念间因果关系。在干预时,CNPC基于专家模型的预测分布与电路计算的干预边缘分布,采用专家产品(PoE)融合方式建模类别分布。理论分析表明,CNPC的组合式干预误差受其模块影响,并在特定条件下接近真实干预分布。在五个基准数据集上,无论分布内还是分布外设置,与五种基线模型相比,CNPC在不同干预属性数量下均实现更高任务准确率。
原文摘要 · Abstract (English)
Concept Bottleneck Models (CBMs) enhance the interpretability of end-to-end neural networks by introducing a layer of concepts and predicting the class label from the concept predictions. A key property of CBMs is that they support interventions, i.e., domain experts can correct mispredicted concept values at test time to improve the final accuracy. However, typical CBMs apply interventions by overwriting only the corrected concept while leaving other concept predictions unchanged, which ignores causal dependencies among concepts. To address this, we propose the Causal Neural Probabilistic Circuit (CNPC), which combines a neural attribute predictor with a causal probabilistic circuit compiled from a causal graph. This circuit supports exact, tractable causal inference that inherently respects causal dependencies. Under interventions, CNPC models the class distribution based on a Product of Experts (PoE) that fuses the attribute predictor's predictive distribution with the interventional marginals computed by the circuit. We theoretically characterize the compositional interventional error of CNPC w.r.t. its modules and identify conditions under which CNPC closely matches the ground-truth interventional class distribution. Experiments on five benchmark datasets in both in-distribution and out-of-distribution settings show that, compared with five baseline models, CNPC achieves higher task accuracy across different numbers of intervened attributes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。