用多智能体协作提升大模型推理能力,解决单智能体扩展瓶颈
Two Heads are Better Than One: Test-time Scaling of Multi-agent Collaborative Reasoning
- 将长推理链拆分为多智能体独立处理,降低上下文负担
- 在M500数据集上微调后,模型推理性能显著提升
- 引入CEO代理动态调控协作深度,适合复杂推理任务
测试时扩展(Test-Time Scaling, TTS)已成为增强大语言模型推理能力的有效方法。然而,单智能体TTS面临显著可扩展性瓶颈,过长的推理链导致推理成本上升及因上下文管理失败引发的稳定性问题。为此,我们提出利用多智能体系统(MAS)作为标准TTS的结构升级。通过将单一推理链分解为多个智能体各自管理的独立上下文,MAS提供更稳健的推理扩展框架。我们构建了M500数据集,包含500条由DeepSeek-R1生成的高质量多智能体、多轮协作推理轨迹。在该数据集上进行监督微调后,开源模型得以内化协作推理模式,并在MAS中展现出更优的TTS性能。此外,我们提出一种自适应扩展策略,引入‘CEO’代理动态引导推理过程并优化协作深度。在AgentVerse框架下的大量实验表明,微调后的Qwen2.5-32B-MAS和Phi4-14B-MAS模型显著优于其基线版本。代码已公开于https://github.com/jincan333/MAS-TTS。
原文摘要 · Abstract (English)
Test-Time Scaling has emerged as a powerful method to extend the reasoning capabilities of Large Language Models. However, single-agent TTS faces significant scalability bottlenecks, as excessively long reasoning traces lead to increased inference costs and stability issues caused by context management failures. To address these limitations, we propose leveraging Multi-Agent Systems as a structural upgrade to standard TTS. By decomposing monolithic reasoning chains into distinct, manageable contexts across multiple agents, MAS offers a more robust framework for scaling reasoning. We validate this approach by introducing M500, a dataset comprising 500 high-quality multi-agent, multi-turn collaborative reasoning traces generated via DeepSeek-R1. Through Supervised Fine-Tuning on M500, we enable open-source models to internalize collaborative reasoning patterns and show improved TTS performance in MAS. Furthermore, we propose an adaptive scaling strategy incorporating a ``CEO'' agent to dynamically guide the reasoning process and optimize collaboration depth. Extensive experiments within the AgentVerse framework demonstrate that our fine-tuned models, Qwen2.5-32B-MAS and Phi4-14B-MAS, significantly outperform their base counterparts. Codes are available at https://github.com/jincan333/MAS-TTS.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。