通过辅助任务提升大模型幻觉检测能力,无需外部验证工具。
Learning Auxiliary Tasks Improves Reference-Free Hallucination Detection in Open-Domain Long-Form Generation
- 用辅助任务与主任务联合训练,增强模型自我判断能力
- 在LongFact数据集上比普通微调提升3%准确率
- 适合需要离线检测幻觉的研究者和开发者
幻觉,即生成与事实不符的信息,仍是大语言模型在开放域长文本生成中的重大挑战。现有长文本幻觉检测方法要么局限于特定领域,要么严重依赖外部事实核查工具,而这些工具并非总可用。本文系统研究开放域长文本生成中的无参考幻觉检测问题。研究发现,仅依靠模型内部状态(如输出概率、熵值)无法可靠区分事实性内容与幻觉内容(准确率优于随机猜测)。我们对比了提示法、探针法与微调等方法,发现微调效果最佳。为进一步提升性能,提出新范式RATE-FT,通过引入辅助任务,使模型在幻觉检测主任务的同时学习额外目标。在多种模型家族与数据集上的大量实验表明,该方法有效且具备良好泛化能力,例如在LongFact数据集上相比通用微调方法提升3%。
原文摘要 · Abstract (English)
Hallucination, the generation of factually incorrect information, remains a significant challenge for large language models (LLMs), especially in open-domain long-form generation. Existing approaches for detecting hallucination in long-form tasks either focus on limited domains or rely heavily on external fact-checking tools, which may not always be available. In this work, we systematically investigate reference-free hallucination detection in open-domain long-form responses. Our findings reveal that internal states (e.g., model's output probability and entropy) alone are insufficient for reliably (i.e., better than random guessing) distinguishing between factual and hallucinated content. To enhance detection, we explore various existing approaches, including prompting-based methods, probing, and fine-tuning, with fine-tuning proving the most effective. To further improve the accuracy, we introduce a new paradigm, named RATE-FT, that augments fine-tuning with an auxiliary task for the model to jointly learn with the main task of hallucination detection. With extensive experiments and analysis using a variety of model families & datasets, we demonstrate the effectiveness and generalizability of our method, e.g., +3% over general fine-tuning methods on LongFact.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。