arXiv:2411.17388cs.CLcs.AI2024-11EMNLP被引 24

用大模型当图裁判,提升知识图谱构建质量

Can LLMs be Good Graph Judge for Knowledge Graph Construction?

  • 设计实体中心策略过滤文档噪声
  • 微调大模型作为图质量判官,减少错误提取
  • 在通用与领域数据上均表现优异,适合实际应用

现实场景中,信息检索系统获取的数据多为非结构化文本。将自然语言转换为结构化的知识图谱仍是关键挑战。现有方法存在三大问题:(1)真实文档中噪声较多,导致信息提取混乱;(2)通用大模型在特定领域文档中常提取不准确知识;(3)直接使用大模型构建图谱易产生幻觉。本文提出GraphJudge框架,通过实体中心策略消除文档噪声,并微调大模型作为图判官以提升生成图谱的质量。在两个通用和一个领域特定的文本-图对数据集上的实验表明,该方法在多个基线方法中达到最先进水平,具备强泛化能力。

原文摘要 · Abstract (English)

In real-world scenarios, most of the data obtained from the information retrieval (IR) system is unstructured. Converting natural language sentences into structured Knowledge Graphs (KGs) remains a critical challenge. We identified three limitations with respect to existing KG construction methods: (1) There could be a large amount of noise in real-world documents, which could result in extracting messy information. (2) Naive LLMs usually extract inaccurate knowledge from some domain-specific documents. (3) Hallucination phenomenon cannot be overlooked when directly using LLMs to construct KGs. In this paper, we propose \textbf{GraphJudge}, a KG construction framework to address the aforementioned challenges. In this framework, we designed an entity-centric strategy to eliminate the noise information in the documents. And we fine-tuned a LLM as a graph judge to finally enhance the quality of generated KGs. Experiments conducted on two general and one domain-specific text-graph pair datasets demonstrate state-of-the-art performance against various baseline methods with strong generalization abilities. Our code is available at \href{https://github.com/hhy-huang/GraphJudge}{https://github.com/hhy-huang/GraphJudge}.

知识图谱大模型信息抽取图生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。