arXiv:2509.04492cs.CLcs.AI2025-09被引 13

用少量概率信息检测大模型幻觉,一次生成就可完成。

Learned Hallucination Detection in Black-Box LLMs using Token-level Entropy Production Rate

  • 从有限的顶级概率中提取熵变率,构建无须重采样的检测机制。
  • 在多个数据集和模型上超越现有方法,仅用前10个候选概率即达高精度。
  • 适合黑箱API部署,特别适用于金融报告等高可靠性场景。

大语言模型在问答任务中的幻觉问题严重威胁其实际可用性。本文提出一种稳健的一次性幻觉检测方法,专为数据访问受限的场景设计,如仅提供每标记少数顶级候选对数概率的黑箱LLM API。该方法直接利用非贪婪解码过程中产生的对数概率,推导出熵产生率(EPR)作为基线,后通过监督学习增强。所提模型仅依赖单次生成序列中可获取的顶级标记的熵贡献,无需多次重运行。在多种问答数据集和多类大模型上评估,该估计器显著优于当前最优方法。关键在于,仅使用通常较小的可用概率数量(如每标记前10个),即可实现高性能,证实其在接口受限场景下的实用效率。本工作提供了一种轻量级技术,在一次生成后即可提升问答与检索增强生成系统中大模型输出的可信度。

原文摘要 · Abstract (English)

Hallucinations in Large Language Model (LLM) outputs for Question Answering (QA) tasks can critically undermine their real-world reliability. This paper introduces a methodology for robust, one-shot hallucination detection, specifically designed for scenarios with limited data access, such as interacting with black-box LLM APIs that typically expose only a few top candidate log-probabilities per token. Our approach derives uncertainty indicators directly from these readily available log-probabilities generated during non-greedy decoding. We first derive an Entropy Production Rate (EPR) that offers baseline performance, later augmented with supervised learning. Our learned model leverages the entropic contributions of the accessible top-ranked tokens within a single generated sequence, without multiple re-runs per query. Evaluated across diverse QA datasets and multiple LLMs, this estimator significantly improves token-level hallucination detection over state-of-the-art methods. Crucially, high performance is demonstrated using only the typically small set of available log-probabilities (e.g., top-10 per token), confirming its practical efficiency and suitability for API-constrained deployments. This work provides a lightweight technique to enhance the trustworthiness of LLM responses, at the token level, after a single generation pass, for QA and Retrieval-Augmented Generation (RAG) systems. Our experiments confirmed the performance of our method against existing approaches on public dataset as well as for a financial framework analyzing annual company reports.

幻觉检测大模型黑箱熵分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。