arXiv:2502.03283cs.AIcs.CL2025-02被引 28

让大模型与知识图谱动态协作,自动补全推理路径

SymAgent: A Neural-Symbolic Self-Learning Agent Framework for Complex Reasoning over Knowledge Graphs

  • 将知识图谱视为可交互环境,分步引导推理
  • 用7B小模型达成强于大模型的推理效果
  • 能发现缺失三元组,支持知识图谱自动更新

大型语言模型在解决复杂推理问题时容易产生幻觉,导致错误结果。现有方法虽引入知识图谱(KG)提升推理能力,但存在两大局限:一是假设问题答案均存在于知识图谱中,忽略其不完整性;二是将知识图谱视为静态存储,忽视其中隐含的逻辑结构。本文提出SymAgent,一种神经符号协同自学习框架,实现知识图谱与大模型的深度互动。将知识图谱视为动态环境,把复杂推理转化为多步交互过程。框架包含两个模块:Agent-Planner利用大模型归纳能力从知识图谱中提取符号规则,指导问题分解;Agent-Executor自主调用预定义工具,融合知识图谱与外部文档信息,缓解知识图谱不完整问题。此外,设计包含在线探索与离线迭代策略更新的自学习机制,使代理能自动合成推理路径并持续优化。实验表明,使用弱小模型(如7B系列)的SymAgent性能优于或媲美多种强基线。进一步分析显示,该代理能识别缺失三元组,支持知识图谱自动补全。

原文摘要 · Abstract (English)

Recent advancements have highlighted that Large Language Models (LLMs) are prone to hallucinations when solving complex reasoning problems, leading to erroneous results. To tackle this issue, researchers incorporate Knowledge Graphs (KGs) to improve the reasoning ability of LLMs. However, existing methods face two limitations: 1) they typically assume that all answers to the questions are contained in KGs, neglecting the incompleteness issue of KGs, and 2) they treat the KG as a static repository and overlook the implicit logical reasoning structures inherent in KGs. In this paper, we introduce SymAgent, an innovative neural-symbolic agent framework that achieves collaborative augmentation between KGs and LLMs. We conceptualize KGs as dynamic environments and transform complex reasoning tasks into a multi-step interactive process, enabling KGs to participate deeply in the reasoning process. SymAgent consists of two modules: Agent-Planner and Agent-Executor. The Agent-Planner leverages LLM's inductive reasoning capability to extract symbolic rules from KGs, guiding efficient question decomposition. The Agent-Executor autonomously invokes predefined action tools to integrate information from KGs and external documents, addressing the issues of KG incompleteness. Furthermore, we design a self-learning framework comprising online exploration and offline iterative policy updating phases, enabling the agent to automatically synthesize reasoning trajectories and improve performance. Experimental results demonstrate that SymAgent with weak LLM backbones (i.e., 7B series) yields better or comparable performance compared to various strong baselines. Further analysis reveals that our agent can identify missing triples, facilitating automatic KG updates.

知识图谱大模型推理自学习神经符号

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。