用图结构推理提升大模型幻觉检测能力,效果超越GPT-4且模型更小
FactCG: Enhancing Fact Checkers with Graph-Based Multi-Hop Data
- 构建文档上下文图,通过多跳推理生成合成训练数据
- 在LLM-Aggrefact基准上优于GPT-4-o,模型规模显著更小
- 适合需要高效高精度幻觉检测的部署场景
现有大语言模型幻觉检测模型的训练依赖公开自然语言推理(NLI)数据和合成数据。然而,传统NLI数据集不适用于文档级推理,而现有合成数据生成方法通过逐句移除并使用LLM提示标注事实性,计算开销大且受限于LLM能力。本文分析了现有合成数据与真实LLM输出之间的差异,提出新方法CG2C:基于从文档中提取的上下文图进行多跳推理,生成合成训练数据。基于此构建的FactCG模型,在相同骨干模型下表现出更强的连贯推理能力。实验表明,其在LLM-Aggrefact基准上超越GPT-4-o,且模型规模远小于后者。
原文摘要 · Abstract (English)
Prior research on training grounded factuality classification models to detect hallucinations in large language models (LLMs) has relied on public natural language inference (NLI) data and synthetic data. However, conventional NLI datasets are not well-suited for document-level reasoning, which is critical for detecting LLM hallucinations. Recent approaches to document-level synthetic data generation involve iteratively removing sentences from documents and annotating factuality using LLM-based prompts. While effective, this method is computationally expensive for long documents and limited by the LLM's capabilities. In this work, we analyze the differences between existing synthetic training data used in state-of-the-art models and real LLM output claims. Based on our findings, we propose a novel approach for synthetic data generation, CG2C, that leverages multi-hop reasoning on context graphs extracted from documents. Our fact checker model, FactCG, demonstrates improved performance with more connected reasoning, using the same backbone models. Experiments show it even outperforms GPT-4-o on the LLM-Aggrefact benchmark with much smaller model size.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。