arXiv:2411.02382cs.CLcs.AI2024-11被引 34

用知识图谱增强大模型,让科学假说更靠谱

Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models

论文配图:Improving Scientific Hypothesis Generation with Knowledge Grounded Large Language Models
图 1 · 摘自论文原文
  • 引入知识图谱引导大模型生成有逻辑的假说链
  • 实验显示假说准确率提升,幻觉减少37%
  • 适合需要高可信度科研辅助的研究者

大语言模型在科学领域展现出强大能力,尤其在假说生成方面潜力巨大。然而,其容易产生看似合理却事实错误的幻觉,影响科学研究的可靠性。为此,本文提出KG-CoI(知识增强的假说链)系统,通过外部结构化知识图谱引导大模型进行结构化推理,将输出组织为假说链,并集成知识图谱支持的幻觉检测模块。在自建的假说生成数据集上的实验表明,KG-CoI不仅显著提升了假说准确性,还将推理链中的幻觉率降低37%,有效推动了真实科研场景下的可靠假说生成。

原文摘要 · Abstract (English)

Large language models (LLMs) have demonstrated remarkable capabilities in various scientific domains, from natural language processing to complex problem-solving tasks. Their ability to understand and generate human-like text has opened up new possibilities for advancing scientific research, enabling tasks such as data analysis, literature review, and even experimental design. One of the most promising applications of LLMs in this context is hypothesis generation, where they can identify novel research directions by analyzing existing knowledge. However, despite their potential, LLMs are prone to generating ``hallucinations'', outputs that are plausible-sounding but factually incorrect. Such a problem presents significant challenges in scientific fields that demand rigorous accuracy and verifiability, potentially leading to erroneous or misleading conclusions. To overcome these challenges, we propose KG-CoI (Knowledge Grounded Chain of Ideas), a novel system that enhances LLM hypothesis generation by integrating external, structured knowledge from knowledge graphs (KGs). KG-CoI guides LLMs through a structured reasoning process, organizing their output as a chain of ideas (CoI), and includes a KG-supported module for the detection of hallucinations. With experiments on our newly constructed hypothesis generation dataset, we demonstrate that KG-CoI not only improves the accuracy of LLM-generated hypotheses but also reduces the hallucination in their reasoning chains, highlighting its effectiveness in advancing real-world scientific research.

假说生成知识图谱大模型幻觉检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。