arXiv:2505.21926cs.CLcs.AI2025-05ACL被引 2

MERRY模型让知识图谱具备通用推理能力,能处理图内图外任务。

Beyond Completion: A Foundation Model for General Knowledge Graph Reasoning

  • 融合结构与文本信息,用多视角消息传递架构打通模态
  • 28个数据集测试中超越多数基线,图外问答任务表现突出
  • 适合需要跨任务通用推理的知识图谱研究者使用

在自然语言处理与计算机视觉中,基础模型已在多种任务上展现强大潜力。然而,尽管知识图谱(KG)蕴含丰富的结构与文本信息,现有知识图谱基础模型研究仍主要聚焦于结构层面,多数工作局限于图内任务(如知识图谱补全,KGC)。这一局限阻碍了应对更复杂图外任务的进展。本文提出MERRY,一种面向通用知识图谱推理的基础模型,评估其在两类任务上的表现:图内推理任务(如KGC)和图外任务(如知识图谱问答,KGQA)。不仅利用图的结构信息,还整合了文本信息。具体地,提出多视角条件消息传递(CMP)编码架构,弥合文本与结构模态的鸿沟,实现无缝融合;引入动态残差融合模块,有选择性保留相关文本信息;设计灵活边评分机制,适应多样下游任务。在28个数据集上的综合评估表明,MERRY在多数场景下优于现有基线,在图内推理中表现出强能力,并在图外任务如KGQA中展现出优异泛化性能。

原文摘要 · Abstract (English)

In natural language processing (NLP) and computer vision (CV), the successful application of foundation models across diverse tasks has demonstrated their remarkable potential. However, despite the rich structural and textual information embedded in knowledge graphs (KGs), existing research of foundation model for KG has primarily focused on their structural aspects, with most efforts restricted to in-KG tasks (e.g., knowledge graph completion, KGC). This limitation has hindered progress in addressing more challenging out-of-KG tasks. In this paper, we introduce MERRY, a foundation model for general knowledge graph reasoning, and investigate its performance across two task categories: in-KG reasoning tasks (e.g., KGC) and out-of-KG tasks (e.g., KG question answering, KGQA). We not only utilize the structural information, but also the textual information in KGs. Specifically, we propose a multi-perspective Conditional Message Passing (CMP) encoding architecture to bridge the gap between textual and structural modalities, enabling their seamless integration. Additionally, we introduce a dynamic residual fusion module to selectively retain relevant textual information and a flexible edge scoring mechanism to adapt to diverse downstream tasks. Comprehensive evaluations on 28 datasets demonstrate that MERRY outperforms existing baselines in most scenarios, showcasing strong reasoning capabilities within KGs and excellent generalization to out-of-KG tasks such as KGQA.

知识图谱基础模型通用推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。