arXiv:2608.05823cs.CL2026-08

提出轻量级无参考幻觉检测框架,可精准定位生成内容中的错误事实

Decomposed Entailment for Factuality Checking and Hallucination Detection

  • 将生成内容拆分为原子命题,用对比学习验证每条命题真伪
  • 在4比特量化模型上优于主流方法,三项基准测试表现领先
  • 输出可追溯的错误定位报告,适合需可信生成的场景

大型语言模型的可靠性常因事实性不一致而受损,包括生成内容与源材料不符的幻觉现象。我们提出HallDetect,一种轻量、无参考、黑盒的幻觉检测框架,不仅在摘要生成任务上评估,还扩展至更广泛的源文本引导生成场景。HallDetect基于分解式事实性评估:将生成内容分解为原子命题,通过紧凑的编码器式蕴含模型,利用多尺度源文本片段库进行对比学习验证,并以非对称评分聚合结果——只要一条命题被明确否定,即判定整体响应为幻觉。在统一4比特量化骨干模型与消费级硬件预算的控制协议下,HallDetect在四项基准中的三项超越同等资源的生成与嵌入基线,且跨模型族表现稳定,同时提供从命题到原文片段的审计路径,实现错误精确定位。

原文摘要 · Abstract (English)

The reliability of Large Language Models (LLMs) is often compromised by factual inconsistencies, including hallucinations---cases where generated content is not supported by the underlying source. We present HallDetect, a lightweight, reference-free, and black-box framework for hallucination detection that we evaluate not only on summarization but across a broader range of source-grounded generation settings. HallDetect builds on decomposition-based factuality evaluation: generated content is decomposed into atomic claims, each verified by a compact encoder-based entailment model through a contrastive formulation over a multi-scale library of source chunks, and aggregated with an asymmetric score in which a single confidently contradicted claim flags the response. Under a controlled protocol in which all methods share the same 4-bit quantized backbones and consumer-grade hardware budget, HallDetect outperforms comparably resourced generative and embedding-based baselines on three of four benchmarks while remaining stable across backbone families, and yields a claim-to-span audit trail that localizes each error.

幻觉检测事实核查LLM可靠性轻量模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。