arXiv:2412.18672cs.CLcs.AI2024-12被引 2

用精心筛选的知识图谱减少大模型幻觉,让回答更准确可信。

From Hallucinations to Facts: Enhancing Language Models with Curated Knowledge Graphs

  • 从维基百科构建精选知识图谱,精准匹配上下文信息。
  • 实验表明该方法显著降低模型生成错误信息的概率。
  • 适合需要高准确性的问答、写作辅助等场景使用。

语言模型的幻觉问题严重影响其在自然语言处理任务中的有效性与可信度,常生成偏离事实或逻辑的回应。本文通过整合精心筛选的知识图谱三元组,将模型输出锚定在真实数据上。我们从维基百科构建了全面的知识图谱库,并通过数据精炼突出训练所需的关键信息。将语言模型接入这一经过筛选的知识资源,使其在生成回答时不仅能保持语言流畅,还能基于事实和上下文相关性进行推理。这种集成为模型提供了坚实的背景知识基础,有效抑制了幻觉现象。实验验证了多种方法在减少虚假回答方面的有效性,证明了精心设计的知识图谱对提升语言模型输出可靠性的重要作用。

原文摘要 · Abstract (English)

Hallucination, a persistent challenge plaguing language models, undermines their efficacy and trustworthiness in various natural language processing endeavors by generating responses that deviate from factual accuracy or coherence. This paper addresses language model hallucination by integrating curated knowledge graph (KG) triples to anchor responses in empirical data. We meticulously select and integrate relevant KG triples tailored to specific contexts, enhancing factual grounding and alignment with input. Our contribution involves constructing a comprehensive KG repository from Wikipedia and refining data to spotlight essential information for model training. By imbuing language models with access to this curated knowledge, we aim to generate both linguistically fluent responses and deeply rooted in factual accuracy and context relevance. This integration mitigates hallucinations by providing a robust foundation of information, enabling models to draw upon a rich reservoir of factual data during response generation. Experimental evaluations demonstrate the effectiveness of multiple approaches in reducing hallucinatory responses, underscoring the role of curated knowledge graphs in improving the reliability and trustworthiness of language model outputs.

知识图谱幻觉抑制大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。