让大模型自己发现并纠正幻觉,实时精准定位错误原因。
Actionable Hallucination Detection: Translating Latent Uncertainty into Agentic Critique

- 用轻量级适配器动态调整模型内部表示,放大不确定性信号。
- 检测准确率达80%以上,AUROC达0.966,比现有方法更精准。
- 适合需要高可靠性推理的AI代理系统,尤其关注幻觉防控。
将大语言模型部署为AI代理时,常出现因未遵循用户指令而生成幻觉动作的问题。现有检测方法无法实时提供可操作的修正反馈,或因延迟过高而难以应用。本文提出一种轻量级低秩适配器(LoRA)——潜在线索批评者(Latent Critic),在冻结基座模型生成过程中同步运行,主动重构Transformer残差流,增强潜在的对齐信号,并将其转化为单序列内局部化的自然语言反馈。通过优化基座模型的原始不确定性信号,该方法在不增加额外推理开销的情况下实现可靠、细粒度的幻觉检测。机制分析表明,该方法将原有的不确定性几何结构转化为线性可分表征,迁移能力优于基座模型自身表征。以工具调用为例,验证了该架构在Qwen和Llama系列模型上的检测效果与下游改进能力。在闭环ReAct环境中,其作为近乎零延迟的防护屏障,能在执行前拦截幻觉行为,并利用精准反馈实现高效自纠错。相比等规模微调的外部检测器、语义熵基线和被动内部探测,本方法在幻觉定位上显著更优,达到0.966 AUROC与超过80%的定位准确率(如未对齐的日期信息)。
原文摘要 · Abstract (English)
Large Language Models (LLMs) deployed as AI agents frequently exhibit user specification-grounding failures, executing hallucinated, undesired actions to force a resolution rather than expressing uncertainty. Existing detection methods fail to provide actionable, real-time correction as they either do not localize the hallucinations, or incur prohibitive inference latency. We introduce the Latent Critic, a lightweight low-rank adapter (LoRA) that operates concurrently with a frozen base LLM's generation to actively restructure the transformer's residual stream---amplifying latent grounding signals and translating them into localized, natural language feedback within a single sequence. By refining the base model's native uncertainty signals, this manipulation of the latent space enables reliable, granular detection without the overhead of secondary inference loops. Mechanistic analysis via activation patching and layer-wise probing shows that this rank-invariant behavior restructures pre-existing uncertainty geometry into a linearly separable representation that transfers more reliably than base model representations alone. Using tool-calling as an instantiation of granular hallucinations, we validate the detection and downstream improvements enabled by the Latent Critic architecture across Qwen and Llama-based models. Demonstrating superior real-time efficacy, our approach significantly outperforms equivalent-scale fine-tuned external detectors, semantic entropy baselines, and passive internal probes in isolating hallucinations, achieving 0.966 AUROC and >80% accuracy in localization (e.g., ungrounded: date). When deployed in a closed-loop ReAct environment, the Critic acts as a negligible latency guardrail, intercepting hallucinations before execution to prevent undesired actions while simultaneously leveraging this specific localized feedback to enable efficient agent self-correction.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。