提出细粒度事实级幻觉检测方法,无需训练数据即可精准定位错误信息。
FactSelfCheck: Fact-Level Black-Box Hallucination Detection for LLMs
- 将文本转为知识图谱三元组,通过多轮生成分析事实一致性
- 在不依赖外部资源下实现35.5%的事实内容提升,优于基线10.6%
- 适用于需要高可信度生成的场景,如医疗、法律等专业领域
大型语言模型常生成幻觉内容,严重威胁关键应用中的事实准确性。现有方法多在句子或段落层面检测幻觉,本文提出FactSelfCheck——一种零资源、黑盒采样式的方法,实现细粒度的事实级检测。该方法将文本表示为可解释的知识图谱,由三元组构成的事实单元,相比传统方法提供更清晰的事实性洞察。通过分析多个LLM生成结果间的一致性,计算细粒度幻觉得分,无需外部资源或训练数据。评估显示,FactSelfCheck在性能上媲美领先句子级采样方法,且能提供更详细可解释的分析。尤为显著的是,其事实级检测使幻觉修正效果大幅提升:相比基线提升35.5%的事实内容,而句子级SelfCheckGPT仅提升10.6%。该方法支持更精确的幻觉识别与修正。此外,我们还构建了FavaMultiSamples数据集,填补采样类方法评估数据的空白,为研究社区提供第二套基准数据。
原文摘要 · Abstract (English)
Large Language Models (LLMs) frequently generate hallucinated content, posing significant challenges for applications where factuality is crucial. While existing hallucination detection methods typically operate at the sentence level or passage level, we propose FactSelfCheck, a novel zero-resource black-box sampling-based method that enables fine-grained fact-level detection. Our approach represents text as interpretable knowledge graphs consisting of facts in the form of triples, providing clearer insights into content factuality than traditional approaches. Through analyzing factual consistency across multiple LLM responses, we compute fine-grained hallucination scores without requiring external resources or training data. Our evaluation demonstrates that FactSelfCheck performs competitively with leading sentence-level sampling-based methods while providing more detailed and interpretable insights. Most notably, our fact-level approach significantly improves hallucination correction, achieving a 35.5% increase in factual content compared to the baseline, while sentence-level SelfCheckGPT yields only a 10.6% improvement. The granular nature of our detection enables more precise identification and correction of hallucinated content. Additionally, we contribute FavaMultiSamples, a novel dataset that addresses a gap in the field by providing the research community with a second dataset for evaluating sampling-based methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。