arXiv:2608.16002cs.CLcs.AI2026-08

通过建模推理过程中的依赖关系,提升大模型代理的不确定性判断能力。

From Sequence to Structure: Relational Uncertainty Propagation for LLM Agents

论文配图:From Sequence to Structure: Relational Uncertainty Propagation for LLM Agents
图 1 · 摘自论文原文
  • 构建轨迹图捕捉推理状态与交互间的时序和语义依赖。
  • 在多任务基准上,不确定性估计准确率显著优于现有方法。
  • 适合需要可靠错误预警的长周期智能体应用。

可靠地量化不确定性(UQ)对在复杂交互环境中部署大语言模型(LLM)代理至关重要。现有方法主要依赖局部信号,如词元概率、预测熵或每步置信度,因而忽略了错误在执行轨迹中跨步骤累积的长程依赖。这导致无法识别起因于多个推理或交互步骤前的代理失败。我们提出RUPA(Relational Uncertainty Propagation for Agents),一种面向LLM代理的轨迹级UQ框架。RUPA将执行历史表示为有向轨迹图,其中推理状态、工具调用和环境反馈作为节点,由时间与语义依赖边连接。随后在该图上传播不确定性,以捕捉执行风险的累积与传递。传播信号结合轨迹级行为特征与目标对齐信息,生成对完整代理轨迹的置信度估计。我们在$τ$-2、Terminal-Bench-2和GAIA等代表性代理基准上,使用6个开源LLM(涵盖多个模型族)评估RUPA。实验结果表明,RUPA持续优于现有方法,提供更准确的不确定性估计,实现更早的失败检测,并改善基于不确定性的代理执行表现。这些结果表明,显式建模关系依赖对于长时程LLM代理的可靠UQ至关重要,为可信代理执行提供了实用基础。

原文摘要 · Abstract (English)

Reliable uncertainty quantification (UQ) is essential for deploying large language model (LLM) agents in complex interactive environments. Existing UQ methods largely rely on local signals, such as token probabilities, predictive entropy, or per-step confidence, and therefore overlook the long-range dependencies through which errors accumulate across an execution trajectory. As a result, they may fail to identify agent failures whose causes originate several reasoning or interaction steps before the final answer. We propose RUPA (Relational Uncertainty Propagation for Agents), a trajectory-level UQ framework for LLM agents. RUPA represents an execution history as a directed trajectory graph in which reasoning states, tool interactions, and environment feedback are nodes connected by temporal and semantic dependency edges. It then propagates uncertainty over this graph to capture how execution risk accumulates and transfers across interaction steps. The propagated signal is combined with trajectory-level behavioral features and goal-alignment information to produce a confidence estimate for the full agent trajectory. We evaluate RUPA on representative agent benchmarks, including $τ$-2, Terminal-Bench-2, and GAIA, using 6 open-source LLMs spanning multiple model families. Experimental results show that RUPA consistently outperforms existing UQ methods by providing more accurate uncertainty estimates, enabling earlier failure detection, and improving uncertainty-guided agent execution across diverse agent tasks. These results demonstrate that explicitly modeling relational dependency is crucial to reliable UQ for long-horizon LLM agents, providing a practical foundation for trustworthy agent execution.

不确定性量化智能体长序列推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。