提出双层并行框架,提升多智能体大模型推理效率与准确率。
A Two-Tier Perspective on Inference-Time Parallelism in Multi-Agent LLM Systems

- 区分任务级并行与路径内并行,统一协调两种并行策略。
- 在GAIA基准上实现更低延迟与更高准确率,但增加令牌消耗。
- 中等复杂度任务最受益于两种并行的协同,过度并行反降低性能。
基于推理时执行视角,本文将多智能体大模型系统的并行性建模为两个层次:任务级的副本并行(Replica Parallelism),用于探索多个完整解题路径;路径内的结构并行(Structural Parallelism),通过任务分解实现单条路径内的并发执行。现有研究尚未系统分析不同并行形式的角色及其相互关系。为此,本文提出TIPEX框架,统一两种并行层次,在统一执行语义下控制并协调其角色,支持多种并行策略与参数配置的系统性组合与分析。在GAIA基准上的系统实验表明,推理时并行可显著提升准确率并降低端到端延迟,代价是令牌消耗增加。进一步分析显示,副本并行与结构并行在任务复杂度中等时表现出互补效应,而过于激进的并行策略未必带来更好表现。
原文摘要 · Abstract (English)
Large language model (LLM)-driven multi-agent systems typically require multiple model invocations and complex coordination during inference, and their execution strategies directly affect system accuracy, latency, and computational cost. Parallel execution provides a means to improve inference-time efficiency. From the perspective of inference-time execution, this paper models parallelism in multi-agent systems as two distinct levels of decision processes: Replica Parallelism, which explores multiple complete solution paths at the task level, and Structural Parallelism, which enables concurrent execution within a single solution path through task decomposition. However, the roles of different forms of parallelism and their interrelationships still lack systematic study in terms of unified organization and coordination. We therefore propose TIPEX, a controllable execution framework that unifies these two levels of parallelism and coordinates their roles within the inference process under a unified execution semantics while supporting systematic combinations and analyses of different parallel strategies and parameter configurations. Systematic experiments on the GAIA benchmark demonstrate that inference-time parallelism can significantly improve accuracy and reduce end-to-end latency at the cost of increased token consumption. Further analysis shows that Replica and Structural Parallelism exhibit complementary effects across task complexities, with tasks of intermediate difficulty benefiting most from their coordination, while overly aggressive parallel strategies do not necessarily yield better performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。