arXiv:2511.05854cs.AI2025-11

小模型学会动态调整检测策略,提前纠错防幻觉。

Can a Small Model Learn to Look Before It Leaps? Dynamic Learning and Proactive Correction for Hallucination Detection

  • 让小模型通过试错学习自适应验证策略,不再死板执行固定流程。
  • 在三个数据集上优于现有方法,小模型也能实现高精度幻觉检测。
  • 适合资源受限场景,如移动端或实时系统中的可靠内容审核。

大语言模型中的幻觉问题仍是安全部署的关键障碍。为实现在真实场景中高效应用幻觉检测,使用高效的小模型至关重要,以确保低延迟和低资源消耗。然而,现有方法依赖固定的验证策略,仅通过微调使小模型模仿固定验证路径,无法捕捉应对多样幻觉模式所需的适应性,导致规划不稳定。为此,我们提出「学习评估与自适应规划」(LEAP)框架,将幻觉检测从固定执行转变为动态策略学习。具体而言,LEAP首先利用强大教师模型通过故障驱动循环迭代探索并优化验证策略。该动态规划能力被蒸馏至高效学生模型,并结合一种新型主动修正机制,使模型能在执行前评估并优化自身验证策略。在三个基准测试上的实验表明,LEAP优于当前最优方法,提供了有效且可扩展的可靠幻觉检测方案。

原文摘要 · Abstract (English)

Hallucination in large language models (LLMs) remains a critical barrier to their safe deployment. For hallucination detection to be practical in real-world scenarios, the use of efficient small models is essential to ensure low latency and minimal resource consumption. However, existing methods rely on fixed verification strategies, where simply tuning small models to mimic fixed verification trajectories fails to capture the adaptability required for diverse hallucination patterns, thereby inducing planning instability. To address this limitation, we propose a ``Learning to Evaluate and Adaptively Plan'' (LEAP) framework, which shifts hallucination detection from fixed execution to dynamic strategy learning. Specifically, LEAP first employs a powerful teacher model to iteratively explore and refine verification strategies through a failure-driven loop. This dynamic planning capability is then distilled into an efficient student model, augmented by a novel proactive correction mechanism that enables the model to evaluate and optimize its verification strategy before execution. Experiments on three benchmarks demonstrate that LEAP outperforms state-of-the-art methods, offering an effective and scalable solution for reliable hallucination detection.

幻觉检测小模型动态规划主动纠错

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。