arXiv:2502.16514cs.CL2025-02ACL被引 20

用知识图谱增强大模型,一次推理就能精准查错。

GraphCheck: Breaking Long-Term Text Barriers with Extracted Knowledge Graph-Powered Fact-Checking

  • 用提取的知识图谱作为软提示,让大模型更好理解复杂逻辑链。
  • 在7个基准上比基线提升最高7.1%,医疗领域表现尤其突出。
  • 只需一次推理,适合对效率和准确率要求高的场景。

大型语言模型广泛使用,但在长文本中常产生细微事实错误,尤其在医学等专业领域后果严重。现有基于文档的查证方法面临两大挑战:一是难以理解长文档中的复杂多跳关系,常遗漏细微错误;二是多数专用方法依赖成对比较,需多次调用模型,资源与计算成本高。为此,我们提出GraphCheck,利用提取的知识图谱增强文本表征,通过图神经网络处理图谱作为软提示,使大模型更有效融入结构化知识。结合图推理能力,GraphCheck能捕捉现有方法常忽略的多跳推理链,实现单次推理下的精准高效查证。在涵盖通用与医学领域的七个基准测试中,性能相比基线最高提升7.1%。显著优于现有专用查证工具,且以更少参数达到DeepSeek-V3和OpenAI-o1等先进大模型相当水平。

原文摘要 · Abstract (English)

Large language models (LLMs) are widely used, but they often generate subtle factual errors, especially in long-form text. These errors are fatal in some specialized domains such as medicine. Existing fact-checking with grounding documents methods face two main challenges: (1) they struggle to understand complex multihop relations in long documents, often overlooking subtle factual errors; (2) most specialized methods rely on pairwise comparisons, requiring multiple model calls, leading to high resource and computational costs. To address these challenges, we propose GraphCheck, a fact-checking framework that uses extracted knowledge graphs to enhance text representation. Graph Neural Networks further process these graphs as a soft prompt, enabling LLMs to incorporate structured knowledge more effectively. Enhanced with graph-based reasoning, GraphCheck captures multihop reasoning chains that are often overlooked by existing methods, enabling precise and efficient fact-checking in a single inference call. Experimental results on seven benchmarks spanning both general and medical domains demonstrate up to a 7.1% overall improvement over baseline models. Notably, GraphCheck outperforms existing specialized fact-checkers and achieves comparable performance with state-of-the-art LLMs, such as DeepSeek-V3 and OpenAI-o1, with significantly fewer parameters.

事实核查知识图谱大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。