arXiv:2607.16643cs.AIcs.CV2026-07

通过多样化微调提升模型幻觉检测能力,让错误回答更易被识别。

Diversity-Oriented Fine-Tuning for Uncertainty-Based Hallucination Detection

论文配图:Diversity-Oriented Fine-Tuning for Uncertainty-Based Hallucination Detection
图 1 · 摘自论文原文
  • 采用监督微调与直接偏好优化,促使模型生成更多样化输出。
  • 微调后幻觉答案的语义熵显著降低,检测效果优于或媲美现有方法。
  • 适合关注大模型可靠性与幻觉问题的研究者与开发者。

现有幻觉检测方法通常在推理阶段进行,不对模型本身做修改。本文探索了增强模型幻觉可检测性的微调策略。针对基于语义熵的检测方法,我们发现许多错误输出未被检测到,原因是模型在多次运行中产生几乎相同的错误答案。为此,提出多样性导向微调,以鼓励更丰富的生成结果。设计了两种具体策略:基于监督微调(SFT)和直接偏好优化(DPO)。大量实验评估了该方法,并分析了微调前后模型的行为变化。结果显示,采用该微调方法后,模型生成幻觉答案时的语义熵更低,提升了幻觉检测的有效性,最终性能优于或相当于当前最优方法。代码将公开发布。

原文摘要 · Abstract (English)

Existing hallucination detection methods are typically conducted at the inference stage, without making any modifications to the model itself. In this paper, we are interested in exploring fine-tuning strategies that enhance the detectability of hallucinations in the resulting model. Focusing on semantic-entropy-based detection, we observe that many erroneous outputs remain undetected because the model produces nearly identical incorrect answers across multiple runs. To address this, we propose diversity-oriented fine-tuning to encourage more varied generations. We introduce two specific strategies: one based on Supervised Fine-Tuning (SFT) and the other on Direct Preference Optimization (DPO). Extensive experiments are conducted to evaluate our approach and analyze the behavior of the models before and after fine-tuning. We find that after adopting our fine-tuning methods, the models become less likely to produce low semantic entropy responses for hallucinated answers, thereby improving the effectiveness of hallucination detection, eventually yielding results better than or comparable with state of the art methods. The code will be publicly released.

幻觉检测微调多样性生成大模型可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。