提出可微神经符号框架ANDRE,实现概率数据下的稳定规则提取
ANDRE: An Attention-based Neuro-symbolic Differentiable Rule Extractor for Inductive Logic Programming

- 用注意力机制构建可微的逻辑与/或操作符,替代固定模板和模糊算子
- 在带噪声和概率谓词的数据上,规则提取准确率显著优于现有方法
- 适合需要可解释性规则且数据含不确定性的场景,如知识图谱补全
归纳逻辑编程(ILP)旨在从数据中学习可解释的一阶逻辑规则,但现有符号与神经符号方法在噪声和概率设定下难以扩展。传统ILP依赖离散组合搜索,在不确定性下易失效;可微ILP方法通常依赖预设规则模板或近似逻辑运算符,存在梯度消失或逻辑结构建模不准问题。本文提出注意力驱动的可微规则提取器ANDRE,通过连续规则空间优化,采用注意力机制实现可微的合取与析取操作符,逼近逻辑极小-极大语义,支持对概率谓词值的精确、稳定且可解释的推理。通过软选择、否定或排除谓词,ANDRE实现灵活规则归纳并保持符号结构。在经典ILP基准、大规模知识库及含概率谓词与噪声标注的合成数据集上的实验表明,ANDRE在预测性能上达到或超越现有方法,且在不确定性下能可靠恢复正确符号规则。尤其在中等程度标签噪声下仍保持鲁棒性,显著优于现有可微ILP方法在规则提取质量与稳定性上的表现。
原文摘要 · Abstract (English)
Inductive Logic Programming (ILP) aims to learn interpretable first-order rules from data, but existing symbolic and neuro-symbolic approaches struggle to scale to noisy and probabilistic settings. Classical ILP relies on discrete combinatorial rule search and is brittle under uncertainty, while differentiable ILP methods typically depend on predefined rule templates or inaccurate fuzzy operators that suffer from vanishing gradients or poor approximation of logical structure when reasoning over probabilistic predicate valuations. This paper proposes an Attention-based Neuro-symbolic Differentiable Rule Extractor (ANDRE), a novel ILP framework that learns first-order logic programs by optimizing over a continuous rule space with attention-based logical operators. ANDRE replaces both rule templates and logical operators with fully differentiable, attention-driven conjunction and disjunction operators that approximate logical min-max semantics, enabling accurate, stable, and interpretable reasoning over probabilistic data. By softly selecting, negating, or excluding predicates within each rule, ANDRE supports flexible rule induction while preserving symbolic structure. Extensive experiments on classical ILP benchmarks, large-scale knowledge bases, and synthetic datasets with probabilistic predicates and noisy supervision demonstrate that ANDRE achieves competitive or superior predictive performance while reliably recovering correct symbolic rules under uncertainty. In particular, ANDRE remains robust to moderate label noise, substantially outperforming existing differentiable ILP methods in both rule extraction quality and stability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。