arXiv:2604.12503cs.CLcs.AI2026-04被引 1

用图结构软提示让大模型在不完整知识图谱中更准推理

Topology-Aware Reasoning over Incomplete Knowledge Graph with Graph-Based Soft Prompting

论文配图:Topology-Aware Reasoning over Incomplete Knowledge Graph with Graph-Based Soft Prompting
图 1 · 摘自论文原文
  • 用GNN将子图编码为软提示,替代传统路径遍历
  • 在4个基准上3个达到顶尖性能,提升对缺失边的鲁棒性
  • 适合需要高精度知识推理且图谱不完整的场景

大型语言模型在知识密集型任务中易产生幻觉。知识库问答(KBQA)通过将生成过程锚定在知识图谱(KG)中缓解此问题。然而,现有多跳KBQA方法依赖显式边遍历,对知识图谱不完整性敏感。本文提出一种基于图的软提示框架,将推理范式从节点级路径遍历转变为子图级推理。具体地,利用图神经网络(GNN)将提取的结构子图编码为软提示,使大模型能基于更丰富的结构上下文进行推理,识别超出直接邻居的相关实体,从而降低对缺失边的敏感性。此外,提出两阶段机制:轻量级大模型先利用软提示定位相关实体与关系,再由更强模型生成证据感知的答案。在四个多跳KBQA基准上的实验表明,该方法在其中三个上达到当前最优性能。代码已开源。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have shown remarkable capabilities across various tasks but remain prone to hallucinations in knowledge-intensive scenarios. Knowledge Base Question Answering (KBQA) mitigates this by grounding generation in Knowledge Graphs (KGs). However, most multi-hop KBQA methods rely on explicit edge traversal, making them fragile to KG incompleteness. In this paper, we proposed a novel graph-based soft prompting framework that shifts the reasoning paradigm from node-level path traversal to subgraph-level reasoning. Specifically, we employ a Graph Neural Network (GNN) to encode extracted structural subgraphs into soft prompts, enabling LLM to reason over richer structural context and identify relevant entities beyond immediate graph neighbors, thereby reducing sensitivity to missing edges. Furthermore, we introduce a two-stage paradigm that reduces computational cost while preserving good performance: a lightweight LLM first leverages the soft prompts to identify question-relevant entities and relations, followed by a more powerful LLM for evidence-aware answer generation. Experiments on four multi-hop KBQA benchmarks show that our approach achieves state-of-the-art performance on three of them, demonstrating its effectiveness. Code is available at the repository: https://github.com/Wangshuaiia/GraSP.

知识图谱大模型推理软提示多跳问答

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。