arXiv:2412.05449cs.CLcs.AI2024-12被引 29

让AI团队协作更高效,提升企业级任务成功率70%。

Towards Effective GenAI Multi-Agent Collaboration: Design and Evaluation for Enterprise Applications

  • 设计双模式协作框架,支持并行沟通与任务引用。
  • 复杂任务成功率达90%,代码类任务性能提升23%。
  • 适合需要多智能体协同的企业应用开发人员。

由大语言模型驱动的AI代理在问题解决方面表现出强大能力。通过整合多个智能体,多智能体协作已成为应对单个智能体无法处理的复杂、多维度问题的有前景方案。然而,协作协议的设计与系统有效性评估对企业的实际应用仍具挑战。本报告提出一种新型多智能体协作框架,并全面评估其协调与路由能力。我们测试了两种核心运行模式:(1) 协调模式,通过并行通信和任务载荷引用实现复杂任务完成;(2) 路由模式,实现智能体间高效消息转发。在三个企业领域设计的定制化场景上进行基准测试,数据集已公开。结果显示:跨智能体通信与载荷引用机制有效,端到端目标成功率达90%;相比单智能体方法,协作可将成功率提升最高达70%;在代码密集型任务中,载荷引用使性能提升23%;采用选择性跳过编排的路由机制可显著降低延迟。这些发现为多智能体系统的规模化企业部署提供重要指导。

原文摘要 · Abstract (English)

AI agents powered by large language models (LLMs) have shown strong capabilities in problem solving. Through combining many intelligent agents, multi-agent collaboration has emerged as a promising approach to tackle complex, multi-faceted problems that exceed the capabilities of single AI agents. However, designing the collaboration protocols and evaluating the effectiveness of these systems remains a significant challenge, especially for enterprise applications. This report addresses these challenges by presenting a comprehensive evaluation of coordination and routing capabilities in a novel multi-agent collaboration framework. We evaluate two key operational modes: (1) a coordination mode enabling complex task completion through parallel communication and payload referencing, and (2) a routing mode for efficient message forwarding between agents. We benchmark on a set of handcrafted scenarios from three enterprise domains, which are publicly released with the report. For coordination capabilities, we demonstrate the effectiveness of inter-agent communication and payload referencing mechanisms, achieving end-to-end goal success rates of 90%. Our analysis yields several key findings: multi-agent collaboration enhances goal success rates by up to 70% compared to single-agent approaches in our benchmarks; payload referencing improves performance on code-intensive tasks by 23%; latency can be substantially reduced with a routing mechanism that selectively bypasses agent orchestration. These findings offer valuable guidance for enterprise deployments of multi-agent systems and advance the development of scalable, efficient multi-agent collaboration frameworks.

多智能体协作企业应用LLM

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。