提出可扩展的细粒度幻觉检测方法,直接在自由文本中识别模型错误。
Scalable Token-Level Hallucination Detection in Large Language Models

- 构建可扩展数据引擎,自动生成大规模幻觉标注数据
- 0.6B小模型经训练后性能超越32B大模型,模型越大效果越好
- 无需分步解析,适用于多样化实际场景
大型语言模型虽能力强大,但仍常产生难以察觉的幻觉。传统步骤级分析因依赖人工分步且粒度粗,难以扩展。为此,我们提出TokenHD,一个端到端的令牌级幻觉检测训练框架。其包含可扩展的数据生成引擎与重要性加权训练策略,支持从0.6B到8B不同规模模型的训练。实验表明,即使0.6B的小模型经训练后也超越了QwQ-32B等大型推理模型;检测性能随模型规模持续提升。该检测器直接作用于自由文本,无需预定义步骤或格式重写,具备良好的跨领域泛化能力。
原文摘要 · Abstract (English)
Large language models (LLMs) have demonstrated remarkable capabilities, but they still frequently produce hallucinations. These hallucinations are difficult to detect in reasoning-intensive tasks, where the content appears coherent but contains errors like logical flaws and unreliable intermediate results. While step-level analysis is commonly used to detect internal hallucinations, it suffers from limited granularity and poor scalability due to its reliance on step segmentation. To address these limitations, we propose TokenHD, a holistic pipeline for training token-level hallucination detectors. Specifically, TokenHD consists of a scalable data engine for synthesizing large-scale hallucination annotations along with a training recipe featuring an importance-weighted strategy for robust model training. To systematically assess the detection performance, we also provide a rigorous evaluation protocol. Through training within TokenHD, our detector operates directly on free-form text to identify hallucinations, eliminating the need for predefined step segmentation or additional text reformatting. Our experiments show that even a small detector (0.6B) achieves substantial performance gains after training, surpassing much larger reasoning models (e.g., QwQ-32B), and detection performance scales consistently with model size from 0.6B to 8B. Finally, we show that our detector can generalize well across diverse practical scenarios and explore strategies to further enhance its cross-domain generalization capability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。