将多智能体系统能力融入单模型,显著提升复杂推理与规划性能。
IMAGINE: Integrating Multi-Agent System into One Model for Complex Reasoning and Planning
- 把多智能体协作机制整合进单一模型,实现结构化推理。
- 在TravelPlanner上达82.7%成功率,远超671B大模型的40%。
- 小模型即可媲美甚至超越大型多智能体系统,适合高效部署。
尽管大语言模型在多个任务上取得进展,但在复杂推理与规划方面仍面临挑战。例如,即使使用精心设计的提示和显式先验信息,GPT-4o在TravelPlanner数据集的单规划模式下仅达到7%的最终通过率;而Qwen3-8B-Instruct和DeepSeek-R1-671B在思考模式下分别仅达5.9%和40%。虽然结构良好的多智能体系统(MAS)可提供更优的集体推理能力,但常因多轮交互导致高推理成本、长响应延迟且难以端到端训练。为此,我们提出IMAGINE框架——将多智能体系统集成于单一模型中。该框架不仅将MAS的推理与规划能力融入紧凑模型,还通过简单端到端训练显著超越原有多智能体系统。实验表明,以Qwen3-8B-Instruct为基础,经本方法训练后,模型在TravelPlanner上的最终通过率提升至82.7%,远超671B模型的40%,同时保持更小模型规模。
原文摘要 · Abstract (English)
Although large language models (LLMs) have made significant strides across various tasks, they still face significant challenges in complex reasoning and planning. For example, even with carefully designed prompts and prior information explicitly provided, GPT-4o achieves only a 7% Final Pass Rate on the TravelPlanner dataset in the sole-planning mode. Similarly, even in the thinking mode, Qwen3-8B-Instruct and DeepSeek-R1-671B, only achieve Final Pass Rates of 5.9% and 40%, respectively. Although well-organized Multi-Agent Systems (MAS) can offer improved collective reasoning, they often suffer from high reasoning costs due to multi-round internal interactions, long per-response latency, and difficulties in end-to-end training. To address these challenges, we propose a general and scalable framework called IMAGINE, short for Integrating Multi-Agent System into One Model. This framework not only integrates the reasoning and planning capabilities of MAS into a single, compact model, but also significantly surpass the capabilities of the MAS through a simple end-to-end training. Through this pipeline, a single small-scale model is not only able to acquire the structured reasoning and planning capabilities of a well-organized MAS but can also significantly outperform it. Experimental results demonstrate that, when using Qwen3-8B-Instruct as the base model and training it with our method, the model achieves an 82.7% Final Pass Rate on the TravelPlanner benchmark, far exceeding the 40% of DeepSeek-R1-671B, while maintaining a much smaller model size.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。