用逻辑链提升知识图谱的数值推理能力,效果远超现有方法。
CHAINSFORMER: Numerical Reasoning on Knowledge Graphs from a Chain Perspective
- 基于关系-属性链构建多跳推理路径,显式建模逻辑链条。
- 在多个数据集上实现最高20.0%的性能提升,显著优于当前最佳。
- 适合需要精确数值推理的任务,如问答系统与知识补全。
知识图谱上的推理在知识补全和问答系统中起关键作用,能提供更丰富准确的三元组和属性。随着数值属性在刻画实体与关系中的重要性日益增加,其推理能力变得尤为关键。现有图神经网络(GNN)和知识图嵌入(KGE)方法主要依赖同质邻居聚合,隐式嵌入多样三元组,但难以充分挖掘图中逻辑路径的潜力,限制了推理效果。为此,我们提出ChainsFormer,一种基于链的新框架,支持数值推理。该模型不仅显式构建逻辑链,还拓展推理深度至多跳。特别地,引入关系-属性链(RA-Chains)建模序列推理模式,并通过上下文内序列学习捕捉沿链的逐步推理过程。为缓解噪声链影响,设计双曲亲和度评分机制,在可变分辨率空间中选择相关逻辑链。此外,集成注意力数值推理模块,识别关键推理路径,提升准确率与可解释性。实验表明,ChainsFormer显著超越现有最优方法,性能最高提升达20.0%。代码已开源于https://github.com/zhaodazhuang2333/ChainsFormer。
原文摘要 · Abstract (English)
Reasoning over Knowledge Graphs (KGs) plays a pivotal role in knowledge graph completion or question answering systems, providing richer and more accurate triples and attributes. As numerical attributes become increasingly essential in characterizing entities and relations in KGs, the ability to reason over these attributes has gained significant importance. Existing graph-based methods such as Graph Neural Networks (GNNs) and Knowledge Graph Embeddings (KGEs), primarily focus on aggregating homogeneous local neighbors and implicitly embedding diverse triples. However, these approaches often fail to fully leverage the potential of logical paths within the graph, limiting their effectiveness in exploiting the reasoning process. To address these limitations, we propose ChainsFormer, a novel chain-based framework designed to support numerical reasoning. Chainsformer not only explicitly constructs logical chains but also expands the reasoning depth to multiple hops. Specially, we introduces Relation-Attribute Chains (RA-Chains), a specialized logic chain, to model sequential reasoning patterns. ChainsFormer captures the step-by-step nature of multi-hop reasoning along RA-Chains by employing sequential in-context learning. To mitigate the impact of noisy chains, we propose a hyperbolic affinity scoring mechanism that selects relevant logic chains in a variable-resolution space. Furthermore, ChainsFormer incorporates an attention-based numerical reasoner to identify critical reasoning paths, enhancing both reasoning accuracy and transparency. Experimental results demonstrate that ChainsFormer significantly outperforms state-of-the-art methods, achieving up to a 20.0% improvement in performance. The implementations are available at https://github.com/zhaodazhuang2333/ChainsFormer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。