arXiv:2409.17173cs.CLcs.AI2024-09

用填空题方式检测大模型幻觉,保证答案故事一致

A Multiple-Fill-in-the-Blank Exam Approach for Enhancing Zero-Resource Hallucination Detection in Large Language Models

  • 通过多空填空重构原文,保持故事线一致
  • 在多个生成版本中发现幻觉,准确率显著提升
  • 适合需要高可信文本的AI应用开发者

大型语言模型常产生幻觉性文本。现有方法通过概率重生成多版本文本并进行语义比较来检测幻觉,但若重生成内容的故事线发生变化,导致无法比较,进而降低检测精度。本文提出一种基于多空填空测试的新检测方法,首先从原文中遮蔽多个关键对象生成填空题,再多次调用大模型作答,确保生成答案与原故事线一致。最后通过评分量化每句原文的幻觉程度,并考虑原文内部的幻觉传递效应(幻觉雪球)。实验表明,该方法单独使用即优于现有方法,在与已有方法集成时更达当前最优性能。

原文摘要 · Abstract (English)

Large language models (LLMs) often fabricate a hallucinatory text. Several methods have been developed to detect such text by semantically comparing it with the multiple versions probabilistically regenerated. However, a significant issue is that if the storyline of each regenerated text changes, the generated texts become incomparable, which worsen detection accuracy. In this paper, we propose a hallucination detection method that incorporates a multiple-fill-in-the-blank exam approach to address this storyline-changing issue. First, our method creates a multiple-fill-in-the-blank exam by masking multiple objects from the original text. Second, prompts an LLM to repeatedly answer this exam. This approach ensures that the storylines of the exam answers align with the original ones. Finally, quantifies the degree of hallucination for each original sentence by scoring the exam answers, considering the potential for \emph{hallucination snowballing} within the original text itself. Experimental results show that our method alone not only outperforms existing methods, but also achieves clearer state-of-the-art performance in the ensembles with existing methods.

幻觉检测大模型填空题可信生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。