arXiv:2601.15703cs.AIcs.CL2026-01被引 12

让AI Agent主动识别并纠正幻觉,提升长程推理可靠性

Agentic Uncertainty Quantification

  • 将不确定信息转化为双向控制信号,动态调节推理深度
  • 在闭环与开放任务中均实现更优性能与轨迹校准
  • 适合需要高可靠性的复杂决策场景

尽管AI代理在长程推理中表现出色,但其可靠性受制于‘幻觉螺旋’——早期认知错误会不可逆地传播。现有方法面临两难:不确定性量化(UQ)通常仅被动诊断风险,而自我反思机制则存在持续或无目的的修正。为此,我们提出统一的双过程代理式不确定性量化(AUQ)框架,将口头化不确定性转化为主动、双向控制信号。该架构包含两个互补机制:系统1(不确定性感知记忆,UAM),隐式传递置信度与语义解释,防止盲目决策;系统2(不确定性感知反思,UAR),利用这些解释作为理性线索,在必要时触发目标明确的推理期修正。这使代理能动态平衡高效执行与深度思考。在闭环基准和开放式深度研究任务上的大量实验表明,无需训练的该方法实现了更优性能与轨迹级校准。我们认为,这一原理性框架是迈向可靠代理的重要一步。

原文摘要 · Abstract (English)

Although AI agents have demonstrated impressive capabilities in long-horizon reasoning, their reliability is severely hampered by the ``Spiral of Hallucination,'' where early epistemic errors propagate irreversibly. Existing methods face a dilemma: uncertainty quantification (UQ) methods typically act as passive sensors, only diagnosing risks without addressing them, while self-reflection mechanisms suffer from continuous or aimless corrections. To bridge this gap, we propose a unified Dual-Process Agentic UQ (AUQ) framework that transforms verbalized uncertainty into active, bi-directional control signals. Our architecture comprises two complementary mechanisms: System 1 (Uncertainty-Aware Memory, UAM), which implicitly propagates verbalized confidence and semantic explanations to prevent blind decision-making; and System 2 (Uncertainty-Aware Reflection, UAR), which utilizes these explanations as rational cues to trigger targeted inference-time resolution only when necessary. This enables the agent to balance efficient execution and deep deliberation dynamically. Extensive experiments on closed-loop benchmarks and open-ended deep research tasks demonstrate that our training-free approach achieves superior performance and trajectory-level calibration. We believe this principled framework AUQ represents a significant step towards reliable agents.

AI代理不确定性量化幻觉抑制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。