用LLM优化的多智能体MCTS系统,提升复杂问题求解效率与准确率。
MASTER: A Multi-Agent System with LLM Specialized MCTS
- 基于LLM的专用MCTS,动态调度智能体数量和通信
- 在HotpotQA上达76%准确率,WebShop上达80%
- 适合需要复杂推理的任务,如开放域问答与多步规划
大型语言模型(LLM)在求解任务中日益受到关注,但其策略规划能力常受质疑。近期研究引入蒙特卡洛树搜索(MCTS)以增强LLM的规划能力。然而,MCTS依赖大量采样模拟来近似真实奖励分布,带来两个主要问题:一是对于围棋类任务,模拟结果可提供客观奖励(如胜为1,负为0),但对于问答类任务,模拟结果仅为答案,无法获得客观奖励而缺乏反馈;二是获得统计显著的奖励估计通常需超过30次模拟,导致大量令牌消耗和时间开销。为此,我们提出多智能体系统MASTER(Multi-Agent System with Tactical Execution and Reasoning using LLM Specialized MCTS),通过专用于LLM的MCTS协调智能体招募与通信。该系统根据任务复杂度自主调整智能体数量,并确保其聚焦通信。在多种任务上的全面实验表明,所提框架有效,在HotpotQA上达到76%准确率,在WebShop上达到80%,刷新了这两个数据集的最新性能纪录。
原文摘要 · Abstract (English)
Large Language Models (LLM) are increasingly being explored for problem-solving tasks. However, their strategic planning capability is often viewed with skepticism. Recent studies have incorporated the Monte Carlo Tree Search (MCTS) algorithm to augment the planning capacity of LLM. Despite its potential, MCTS relies on extensive sampling simulations to approximate the true reward distribution, which leads to two primary issues. Firstly, MCTS is effective for tasks like the Game of Go, where simulation results can yield objective rewards (e.g., 1 for a win and 0 for a loss). However, for tasks such as question answering, the result of a simulation is the answer to the question, which cannot yield an objective reward without the ground truth. Secondly, obtaining statistically significant reward estimations typically requires a sample size exceeding 30 simulations, resulting in excessive token usage and time consumption. To address these challenges, we present the Multi-Agent System with Tactical Execution and Reasoning using LLM Specialized MCTS (MASTER), a novel framework that coordinates agent recruitment and communication through LLM specialized MCTS. This system autonomously adjusts the number of agents based on task complexity and ensures focused communication among them. Comprehensive experiments across various tasks demonstrate the effectiveness of our proposed framework. It achieves 76% accuracy on HotpotQA and 80% on WebShop, setting new state-of-the-art performance on these datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。