在相同思考令牌预算下,单智能体模型比多智能体更高效。
Single-Agent LLMs Outperform Multi-Agent Systems on Multi-Hop Reasoning Under Equal Thinking Token Budgets

- 基于信息论,单智能体在上下文利用上更高效。
- 三类模型测试中,单智能体在多跳推理任务上表现持平或更优。
- 揭示了基准测试和接口控制中的偏差,影响多智能体优势判断。
近期研究显示多智能体大模型系统(MAS)性能优异,但其优势常被增加的推理计算所混淆。当计算资源归一化后,单智能体系统(SAS)可达到甚至超越MAS表现,然而其理论基础与评估方法仍不清晰。本文基于数据处理不等式提出信息论论证:在固定推理令牌预算且上下文利用率完美时,单智能体系统更具信息效率。该视角预测,当单智能体有效上下文利用率下降或计算资源增加时,多智能体系统才具备竞争力。我们在三个模型族(Qwen3、DeepSeek-R1-Distill-Llama、Gemini 2.5)上开展受控实验,比较相同预算下的SAS与多种MAS架构。结果表明,当推理令牌恒定时,SAS在多跳推理任务中持续匹配或优于MAS。此外,我们对系统行为与评估方法进行细致诊断,发现API层面的预算控制(尤其是Gemini 2.5)及标准基准存在显著偏差,可能夸大了MAS的优势。总体而言,多数报告的多智能体优势更应归因于未计量的计算量与上下文效应,而非架构本身优势,强调需明确控制计算、上下文与协作间的权衡。
原文摘要 · Abstract (English)
Recent work reports strong performance from multi-agent LLM systems (MAS), but these gains are often confounded by increased test-time computation. When computation is normalized, single-agent systems (SAS) can match or outperform MAS, yet the theoretical basis and evaluation methodology behind this comparison remain unclear. We present an information-theoretic argument, grounded in the Data Processing Inequality, suggesting that under a fixed reasoning-token budget and with perfect context utilization, single-agent systems are more information-efficient. This perspective further predicts that multi-agent systems become competitive when a single agent's effective context utilization is degraded, or when more compute is expended. We test these predictions in a controlled empirical study across three model families (Qwen3, DeepSeek-R1-Distill-Llama, and Gemini 2.5), comparing SAS with multiple MAS architectures under matched budgets. We find that SAS consistently match or outperform MAS on multi-hop reasoning tasks when reasoning tokens are held constant. Beyond aggregate performance, we conduct a detailed diagnostic analysis of system behavior and evaluation methodology. We identify significant artifacts in API-based budget control (particularly in Gemini 2.5) and in standard benchmarks, both of which can inflate apparent gains from MAS. Overall, our results suggest that, for multi-hop reasoning tasks, many reported advantages of multi-agent systems are better explained by unaccounted computation and context effects rather than inherent architectural benefits, and highlight the importance of understanding and explicitly controlling the trade-offs between compute, context, and coordination in agentic systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。