arXiv:2608.10039cs.LG2026-08

用执行反馈生成更可靠的工具调用智能体流程,自动优化工作流结构。

FlowScout: From Execution Feedback to Reliable Tool-Using Agent Workflows

论文配图:FlowScout: From Execution Feedback to Reliable Tool-Using Agent Workflows
图 1 · 摘自论文原文
  • 基于历史记录挖掘工具协作骨架,构建初始流程图
  • 通过蒙特卡洛树搜索结合执行反馈优化流程拓扑,提升准确性
  • 在4个任务领域中表现优于基线,工具调用正确率提升超92%

智能体工作流将大语言模型(LLMs)、工具和控制逻辑组织成明确的执行结构,是构建可靠大模型自动化系统的重要抽象。然而,高质量工作流的构建仍高度依赖人工且需要大量领域知识。现有研究尝试从历史任务解决记录中自动生成工作流,但多为以LLM为中心的流程,将真实工具调用抽象为模拟节点,限制了可用性和稳定性。为此,我们提出FlowScout,一种基于执行反馈的工具集成式智能体工作流生成框架。该框架将工作流表示为由LLM节点、工具调用节点及依赖边构成的有向图。首先从历史记录中挖掘通用的工具协调骨架以构建初始工作流,然后通过蒙特卡洛树搜索结合执行反馈对工作流拓扑进行迭代优化。我们在四个代表性任务领域评估FlowScout,对比三种基线方法(PM4Py、ReAct、AFlow)。实验结果表明,与基线相比,FlowScout生成的工作流在工具调用正确率上至少提升92.69%,执行质量至少提升17.66%,且重复运行间的性能波动更低。

原文摘要 · Abstract (English)

Agentic workflows have become an important abstraction for building reliable LLM-based automation systems by organizing large language models (LLMs), tools, and control logic into explicit execution structures. However, constructing high-quality agentic workflows remains largely manual and requires substantial domain expertise. Recent studies have explored automatic agentic workflow generation from historical task-solving records, but they mainly produce LLM-centric workflows, where real tool executions are abstracted and simulated by LLM nodes, limiting the usability and stability of generated workflows. To address these limitations, we propose FlowScout, an execution-guided framework for generating tool-integrated agentic workflows from historical task-solving records. Specifically, FlowScout represents an agentic workflow as a directed graph composed of LLM nodes, tool-calling nodes, and dependency edges. It first mines a common tool coordination skeleton from historical records to construct an initial workflow, and then refines the workflow topology through Monte Carlo tree search guided by execution feedback. We evaluate FlowScout on four representative task domains and compare it with three baselines, i.e., PM4Py, ReAct and AFlow. Experimental results show that agentic workflows generated by FlowScout improve tool invocation correctness by at least 92.69% and execution quality by at least 17.66% over the baselines, while achieving lower performance variation across repeated runs.

智能体工作流工具调用自动化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。