用公司架构组织多智能体,提升推理效率与成本效益
OrgAgent: Organize Your Multi-Agent System like a Company
- 分三层治理、执行、合规,模拟公司层级管理
- 在SQuAD 2.0上性能提升102.73%,令牌消耗降低74.52%
- 适合需要稳定分工与分层验证的复杂任务场景
基于大语言模型的多智能体系统在复杂推理中展现出巨大潜力,但如何有效组织多个智能体仍是未解问题。本文提出OrgAgent,一种类公司层级结构的多智能体框架,将协作分为治理、执行和合规三层。治理层负责规划与资源分配,执行层完成任务求解与评审,合规层控制最终答案。在多种推理任务、LLM模型、执行模式与策略下评估表明,公司式层级结构普遍优于其他组织形式。此外,层级协调在多数情况下比扁平协作更节省令牌:例如对于GPT-OSS-120B,在SQuAD 2.0上性能提升102.73%,令牌使用减少74.52%。进一步分析显示,当任务需稳定技能分配、可控信息流与分层验证时,层级结构优势最明显。结果强调组织结构是影响多智能体推理效果、成本与协调行为的关键因素。
原文摘要 · Abstract (English)
While large language model-based multi-agent systems have shown strong potential for complex reasoning, how to effectively organize multiple agents remains an open question. In this paper, we introduce OrgAgent, a company-style hierarchical multi-agent framework that separates collaboration into governance, execution, and compliance layers. OrgAgent decomposes multi-agent reasoning into three layers: a governance layer for planning and resource allocation, an execution layer for task solving and review, and a compliance layer for final answer control. By evaluating the framework across reasoning tasks, LLMs, execution modes, and execution policies, we find that multi-agent systems organized in a company-style hierarchy generally outperform other organizational structures. Besides, hierarchical coordination also reduces token consumption relative to flat collaboration in most settings. For example, for GPT-OSS-120B, the hierarchical setting improves performance over flat multi-agent system by 102.73% while reducing token usage by 74.52% on SQuAD 2.0. Further analysis shows that hierarchy helps most when tasks benefit from stable skill assignment, controlled information flow, and layered verification. Overall, our findings highlight organizational structure as an important factor in multi-agent reasoning, shaping not only effectiveness and cost, but also coordination behavior.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。