用蒙特卡洛树搜索优化智能体技能结构与内容,提升任务表现。
Bilevel Optimization of Agent Skills via Monte Carlo Tree Search

- 外层用MCTS搜索技能结构,内层用LLM优化各组件内容。
- 在运筹学问答数据集上,优化后智能体准确率显著提升。
- 适合研究智能体技能设计与多层级优化的开发者。
智能体技能是包含指令、工具和辅助资源的结构化集合,能帮助大语言模型智能体完成特定类型任务。实证表明,技能设计直接影响智能体性能,但系统性优化仍具挑战。由于技能由结构和内容共同决定,优化需同时确定组件结构与内容,形成强耦合的复杂决策空间。本文将此问题建模为双层优化:外层使用蒙特卡洛树搜索(MCTS)探索技能结构,内层在选定结构下利用大语言模型(LLM)精炼组件内容。在开源运筹学问答数据集上的实验表明,该框架有效提升了智能体的任务表现。
原文摘要 · Abstract (English)
Agent \texttt{skills} are structured collections of instructions, tools, and supporting resources that help large language model (LLM) agents perform particular classes of tasks. Empirical evidence shows that the design of \texttt{skills} can materially affect agent task performance, yet systematically optimizing \texttt{skills} remains challenging. Since a \texttt{skill} comprises instructions, tools, and supporting resources in a structured way, optimizing it requires jointly determining both the structure of these components and the content each component contains. This gives rise to a complex decision space with strong interdependence across structure and components. We therefore represent these two coupled decisions as \texttt{skill} structure and component content, and formulate \texttt{skill} optimization as a bilevel optimization problem. We propose a bilevel optimization framework in which an outer loop employs Monte Carlo Tree Search to determine the \texttt{skill} structure, while an inner loop refines the component content within the structure selected by the outer loop. In both loops, we employ LLMs to assist the optimization procedure. We evaluate the proposed framework on an open-source Operations Research Question Answering dataset, and the experimental results suggest that the bilevel optimization framework improves the performance of the agents with the optimized \texttt{skill}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。