将知识图谱编译成概率电路,让神经网络预测更可靠且符合逻辑规则。
To Neuro-Symbolic Classification and Beyond by Compiling Description Logic Ontologies to Probabilistic Circuits
- 用概率电路编码描述逻辑本体,实现可微分的逻辑推理。
- 推理速度比传统工具快三个数量级,生成的数据对模型更具挑战性。
- 适合需要高可信度推理的应用,如医疗诊断与智能问答。
背景:神经符号方法通过逻辑约束提升神经网络分类器的可靠性,但缺乏对本体的原生支持。目标:开发一种神经符号方法,使预测结果严格符合描述逻辑本体所定义的领域知识。方法:将描述逻辑本体编译为电路——一种前馈可微计算图,支持高效查询与变换。我们证明该电路可用于:(i) 生成捕捉本体语义的合成数据集;(ii) 在GPU上高效执行演绎推理;(iii) 实现预测近似或可证明一致于本体知识的神经符号模型。结果:使用电路生成的合成数据在语义上忠实于本体,且对机器学习模型(包括神经网络)具有挑战性。此外,本体编译为电路的方法在可扩展推理方面表现优异,运行时间比现有推理器快达三个数量级。最后,我们的神经符号分类器在预测一致性上显著优于神经网络基线,同时保持竞争力甚至超越其性能。结论:通过将描述逻辑本体编译为电路,实现了深度学习与知识表示领域的更紧密融合。单一电路表示可解决多个与现实应用密切相关的重要任务。
原文摘要 · Abstract (English)
Background: Neuro-symbolic methods enhance the reliability of neural network classifiers through logical constraints, but they lack native support for ontologies. Objectives: We aim to develop a neuro-symbolic method that reliably outputs predictions consistent with a Description Logic ontology that formalizes domain-specific knowledge. Methods: We encode a Description Logic ontology as a circuit, a feed-forward differentiable computational graph that supports tractable execution of queries and transformations. We show that the circuit can be used to (i) generate synthetic datasets that capture the semantics of the ontology; (ii) efficiently perform deductive reasoning on a GPU; (iii) implement neuro-symbolic models whose predictions are approximately or provably consistent with the knowledge defined in the ontology. Results We show that the synthetic dataset generated using the circuit qualitatively captures the semantics of the ontology while being challenging for Machine Learning classifiers, including neural networks. Moreover, we show that compiling the ontology into a circuit is a promising approach for scalable deductive reasoning, with runtimes up to three orders of magnitude faster than available reasoners. Finally, we show that our neuro-symbolic classifiers reliably produce consistent predictions when compared to neural network baselines, maintaining competitive performances or even outperforming them. Conclusions By compiling Description Logic ontologies into circuits, we obtain a tighter integration between the Deep Learning and Knowledge Representation fields. We show that a single circuit representation can be used to tackle different challenging tasks closely related to real-world applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。