用博弈论分析AI工作流中各组件贡献,找到最优组合方式。
Understanding and Optimizing Agentic Workflows via Shapley value
- 引入合作博弈论的谢林值,量化每个组件在工作流中的贡献。
- 在7种场景下验证,新方法优于单一大模型的通用流程。
- 构建超1500个任务分析,给出跨领域的优化设计建议。
智能体工作流已成为构建复杂AI系统的主要范式,通过协调规划、推理、执行和反思等专用模块来应对现实世界中的高阶任务。然而,由于组件间存在复杂的依赖关系且缺乏系统性的归因方法,对这类工作流进行分析与优化仍面临挑战。本文提出ShapleyFlow,首个采用合作博弈论分析与优化智能体工作流的框架。通过计算所有可能组件配置下的谢林值,该框架实现组件贡献的细粒度归因,并可发现针对特定任务的最优配置。我们在包含导航、数学和操作系统等7种场景的构造数据集上进行了评估,主要贡献包括:(1) 提出一种基于博弈论的智能体工作流贡献归因理论框架;(2) 实现任务特异性组件配置的自动发现,在所有测试任务中均优于依赖单一大语言模型的工作流;(3) 构建并分析超过1500个任务,提供可操作的跨领域优化洞察与设计指南。
原文摘要 · Abstract (English)
Agentic workflows have become the dominant paradigm for building complex AI systems, orchestrating specialized components, such as planning, reasoning, action execution, and reflection, to tackle sophisticated real-world tasks. However, systematically analyzing and optimizing these workflows remains challenging due to intricate component interdependencies and the lack of principled attribution methods. In this work, we introduce ShapleyFlow, the first framework that employs cooperative game theory to analyze and optimize agentic workflows. By applying the Shapley value to evaluate all possible component configurations, ShapleyFlow enables fine-grained attribution of each component's contribution and facilitates the identification of task-specific optimal configurations. Through a constructed dataset evaluated across 7 scenarios, such as navigation, math and OS, we demonstrate 3 key contributions: (1) Theoretical Framework: a principled game-theoretic approach for the attribution of contributions in agentic workflows. (2) Optimal Workflow Discovery: ShapleyFlow identifies task-specific component configurations that consistently outperform workflows relying on a single LLM across all tested tasks. (3) Comprehensive Analysis: we construct and analyze over 1,500 tasks, providing actionable insights and design guidelines for optimizing workflows across multiple domains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。