arXiv:2609.09153cs.AIcs.CL2026-09

用可自进化图结构让大模型智能体更懂做事顺序和条件。

Procedural Graphs: Self-Evolving Execution Structures for LLM Agents

论文配图:Procedural Graphs: Self-Evolving Execution Structures for LLM Agents
图 1 · 摘自论文原文
  • 构建程序图,用节点间关系显式表达‘做什么、何时做’的流程知识。
  • 在多个任务上超越记忆型基线,自进化使性能持续提升。
  • 适合需要长程规划与工具调用的复杂智能体系统设计者。

大型语言模型越来越多地被用作智能体,在长程规划中通过外部工具执行动作。现有方法通常基于累积历史无约束生成动作,隐含了行动顺序与条件判断的程序性知识。随着轨迹变长,智能体容易偏离目标、错序调用工具或重复无效操作。本文提出程序图(Procedural Graph):如同知识图谱以三元组组织事实知识,程序图以(过程,关系,过程)三元组组织程序性知识,回答‘该做什么’的问题。每一步决策时,框架定位当前活跃节点,引导模型将邻近子图转化为步骤级情境指引,指导下一步行动但不强制。图结构可自演化:一个大模型提炼器对比失败与成功轨迹,修改图拓扑与属性,仅保留能提升验证集表现的更新,同时保留被拒绝的路径以防重复。从极简骨架开始,循环构建出性能媲美甚至超过人工设计的图结构,亦可修复有缺陷的专家先验。在多种数据集、任务类型与大模型上,程序图均稳定优于基于记忆的基线,且自演化进一步提升性能,无需人工干预。

原文摘要 · Abstract (English)

Large language models are increasingly deployed as agents that plan over long horizons and act through external tools. Most agents select actions through unconstrained generation over an accumulating history, leaving implicit the procedural knowledge of what to do, in what order, and under which conditions. As trajectories lengthen, agents can lose track of their objectives, invoke tools out of order, and repeat unproductive actions. We introduce the Procedural Graph: just as a knowledge graph organizes factual knowledge into (entity, relation, entity) triplets for what-is questions, a Procedural Graph organizes procedural knowledge into (procedure, relation, procedure) triplets for what-to-do questions. At each decision step, the framework localizes the agent's active node, and a guidance model translates the surrounding subgraph into step-level situational guidance that biases the solver's next action without dictating it. The graph is self-evolving: an LLM refiner contrasts failed trajectories with successful ones and edits the graph's topology and attributes, committing edits that preserve or improve held-out validation performance while retaining rejected ones to discourage repetition. Starting from a minimal skeleton, the loop builds graphs that match or surpass hand-designed ones. It can also repair a flawed expert prior. Across multiple datasets, task types, and LLMs, the Procedural Graph delivers consistent gains over memory-based baselines, and self-evolution further improves performance without manual engineering.

智能体程序图自进化规划

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。