arXiv:2607.09175cs.AIcs.CL2026-07被引 1

用图结构提升长时序智能体指令的可靠验证能力

Scoped Verification for Reliable Long-Horizon Agentic Context Evolution under Distribution Shift

论文配图:Scoped Verification for Reliable Long-Horizon Agentic Context Evolution under Distribution Shift
图 1 · 摘自论文原文
  • 将指令维护为带类型语义图,仅在局部邻域验证更新
  • 最终可靠性达0.673,超越零样本基准两倍以上
  • 适合长期演化的智能体系统开发者参考

部署的大型语言模型智能体依赖于智能体上下文——由运行时框架组装的外部文本控制内容。本文中,该上下文的可变部分是持续更新的系统级指令,基于操作经验迭代优化,而模型、工具和框架保持不变。随着演化进程拉长,扁平文本维护导致指令累积并相互作用,验证难度剧增。为此提出图正则化智能体上下文演化方法(GRACE),将持久指令组件建模为有类型的语义图,并在修改节点的局部类型邻域内验证更新提议。通过增量编辑方式将被接受的更新重构为部署时使用的文本指令检查点。在基于τ²-bench构建的固定电信智能体框架下,采用受控分布偏移协议评估。在五次独立复现中,GRACE将严格可靠性(pass^3)从Gemini 2.5 Flash零样本基线的0.091提升至最终检查点0.673±0.136,超过同数据集上Gemini 3.1 Pro零样本参考值0.242,显著优于扁平文本基线的0.191±0.051。结果揭示可靠长时序上下文演化的两个关键:支持局部验证的结构基础,以及保持累积指令可用性的整合机制。

原文摘要 · Abstract (English)

Deployed LLM agents rely on agentic context, the model-external textual control content assembled by an operational harness. In this work, the mutable component of that context is a persistent system-level instruction that is updated from operational experience while the model, tools, and harness remain fixed. Over long evolution horizons, flat-text maintenance makes verification increasingly difficult as accumulated instructions grow and interact. We propose Graph-Regularized Agentic Context Evolution (GRACE), which maintains the persistent instruction component as a typed semantic graph and validates proposed updates within the local typed neighborhoods of modified nodes. Accepted graph updates are reconstructed as incremental edits to the textual instruction checkpoint used at deployment. We evaluate GRACE within a fixed telecom agent harness derived from $τ^2$-bench under a controlled distribution-shift protocol. Across five independent replications, GRACE improves strict reliability, measured by pass^3, from the Gemini 2.5 Flash zero-shot value of 0.091 to 0.673$\pm$0.136 at the final checkpoint. This exceeds a Gemini 3.1 Pro zero-shot reference of 0.242 on the same held-out set, while the flat-text HCE baseline finishes at 0.191$\pm$0.051. These results identify two requirements for reliable long-horizon context evolution, a structural substrate that makes verification local and a consolidation mechanism that keeps accumulated instruction content usable.

智能体系统上下文演化图结构可靠性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。