arXiv:2601.10560cs.MAcs.AI2026-01被引 2

提出LAMaS框架,让多智能体系统在保持准确率前提下,端到端延迟降低超50%。

Learning Latency-Aware Orchestration for Multi-Agent Systems

  • 训练时用关键路径感知的信用分配,学习低延迟执行图
  • 推理时通过轻量控制器动态消除冗余交互,进一步降延时
  • 模块化设计,可迁移至其他多智能体系统

多智能体系统(MAS)通过结构化工作流协调多个基于大模型的智能体,虽增强推理能力,但因多步执行和重复调用模型导致高推理延迟。现有编排方法主要优化任务性能和推理成本,忽视延迟问题。在MAS中,端到端延迟由关键执行路径决定,单纯降低总成本无法可靠减少延迟。此外,在保持准确性的同时优化延迟仍具挑战:盲目优化延迟可能错误分配操作层级信用,损害任务准确率。为此,我们提出延迟感知型多智能体系统(LAMaS),一种面向学习型多智能体系统的延迟感知编排框架。LAMaS在两个层面应对该挑战:训练阶段,通过关键路径感知的约束优化学习延迟感知执行图;推理阶段,由于训练时确定的图无法利用运行时证据,其补充一个轻量级控制器,随执行过程自适应地消除冗余未来交互。在四个基准上的实验表明,LAMaS在所有评估的学习型MAS基线中达到最低延迟,端到端延迟降低超过50%,同时保持竞争力或更优的准确率。该框架具有模块化特性,可轻松迁移到其他MAS,始终带来显著延迟降低。

原文摘要 · Abstract (English)

Multi-agent systems (MAS) coordinate multiple LLM-powered agents through structured workflows, gaining reasoning power but incurring high inference latency from multi-step execution and repeated model invocations. Existing orchestration methods primarily optimize task performance and inference cost, leaving latency largely unaddressed. In MAS, end-to-end latency is governed by the \textit{critical execution path}, so reducing total cost alone does not reliably reduce latency. Moreover, optimizing latency while preserving accuracy remains non-trivial: naive latency optimization can misassign operator-level credit and degrade task accuracy. To address this gap, we propose \textbf{L}atency-\textbf{A}ware \textbf{M}ulti-\textbf{a}gent \textbf{S}ystem (\textbf{LAMaS}), a latency-aware orchestration framework for learning-based multi-agent systems. LAMaS addresses this challenge at two levels: at \emph{training time}, it learns latency-aware execution graphs through constrained optimization with critical-path-aware credit assignment; at \emph{inference time}, since a graph committed at training time cannot exploit runtime evidence, it complements graph construction with a lightweight controller that adaptively eliminates redundant future agent interactions as execution unfolds. Experiments on four benchmarks show that LAMaS achieves the best latency among evaluated learning-based MAS baselines, reducing end-to-end latency by over 50% while maintaining competitive or better accuracy. LAMaS is also modular and transfers to other MAS with minimal changes, consistently yielding latency reductions.

多智能体延迟优化大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。