对比两种AI协作模式,发现不同任务下该用并行搜索还是专家分工。
An Empirical Study of Multi-Agent Collaboration for Automated Research
- 设计并行子代理与专家团队两种协作结构进行对比实验。
- 时间紧时并行模式更稳且高效,算力足时团队模式更利于深度优化。
- 适合构建能自动调整协作方式的智能研究系统开发者参考。
随着AI代理的发展,研究社区正从单个大语言模型转向多智能体系统(MAS),以克服自动化研究中的认知瓶颈。然而,最优的多智能体协同框架仍不明确。本文通过一个严格控制、基于执行的测试平台(配备Git worktree隔离和显式全局记忆),对比了单智能体基线与两种多智能体范式:子代理架构(并行探索后整合)与团队架构(执行前分工的专家协作)。在固定计算时间预算下评估,结果揭示操作稳定性与理论思辨之间的根本权衡:子代理模式在严苛时间约束下表现稳健、吞吐量高,适用于广度优化;而团队架构因多作者代码生成导致操作脆弱性更高,但在充足算力下能实现复杂架构重构所需的深度理论对齐。这些实证洞察为未来自主研究系统的构建提供了可操作指南,倡导采用动态路由架构,根据任务复杂度实时调整协作方式。
原文摘要 · Abstract (English)
As AI agents evolve, the community is rapidly shifting from single Large Language Models (LLMs) to Multi-Agent Systems (MAS) to overcome cognitive bottlenecks in automated research. However, the optimal multi-agent coordination framework for these autonomous agents remains largely unexplored. In this paper, we present a systematic empirical study investigating the comparative efficacy of distinct multi-agent structures for automated machine learning optimization. Utilizing a rigorously controlled, execution-based testbed equipped with Git worktree isolation and explicit global memory, we benchmark a single-agent baseline against two multi-agent paradigms: a subagent architecture (parallel exploration with post-hoc consolidation) and an agent team architecture (experts with pre-execution handoffs). By evaluating these systems under strictly fixed computational time budgets, our findings reveal a fundamental trade-off between operational stability and theoretical deliberation. The subagent mode functions as a highly resilient, high-throughput search engine optimal for broad, shallow optimizations under strict time constraints. Conversely, the agent team topology exhibits higher operational fragility due to multi-author code generation but achieves the deep theoretical alignment necessary for complex architectural refactoring given extended compute budgets. These empirical insights provide actionable guidelines for designing future autoresearch systems, advocating for dynamically routed architectures that adapt their collaborative structures to real-time task complexity.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。