arXiv:2604.17353cs.AIcs.DC2026-04

Hive通过智能调度与缓存,让多智能体系统跑得更快更省资源。

Hive: A Multi-Agent Infrastructure for Algorithm- and Task-Level Scaling

论文配图:Hive: A Multi-Agent Infrastructure for Algorithm- and Task-Level Scaling
图 1 · 摘自论文原文
  • 用中间结果缓存消除多路径推理重复计算
  • 按智能体贡献分配算力,提速1.11至1.76倍
  • 适合复杂任务分解的多智能体系统开发者

大型语言模型正被部署为复杂的智能体系统,随任务复杂度提升而扩展。尽管已有研究聚焦模型与系统层面的扩展,算法与任务层面的扩展仍缺乏探索,制约了智能体系统的潜力。在算法层面,增加推理时计算可提升工作流容量,但会引入跨路径冗余:多个推理分支间存在重复计算。在任务层面,复杂任务可分解为子问题并分派给多个智能体,以实现更好的可扩展性与并行性。然而,现有基础设施的调度机制未考虑多智能体的存在,错失优化资源分配的机会。我们提出Hive,一种支持算法与任务层面扩展的多智能体架构。Hive包含描述前端,用于捕捉各智能体行为,并支持测试时扩展算法。基于此规范,其后端引入两项关键机制:Logits Cache通过重用冗余采样路径间的中间输出,缓解算法层面的跨路径冗余;Agent-Aware Scheduling则根据智能体贡献动态分配计算与键值缓存资源,优化任务层面的资源利用。实验表明,Logits Cache在重采样场景下平均加速1.11×–1.76×,Agent-Aware Scheduling将热点缺失率降低33%–51%。

原文摘要 · Abstract (English)

Large language models are increasingly deployed as complex agentic systems that scale with task complexity. While prior work has extensively explored model- and system-level scaling, algorithm- and task-level scaling remain largely unaddressed, constraining the full potential of agentic systems. At the algorithm level, allocating additional inference-time computation can enhance workflow capacity but introduces cross-path redundancy: overlapping computations across multiple reasoning branches. At the task level, complex tasks can be decomposed into subproblems and delegated across multiple agents for improved scalability and parallelism. However, existing infrastructures' scheduling is unaware of the existence of multiple agents, missing opportunities to optimize resource allocation. We propose Hive, a multi-agent infrastructure that enables algorithm- and task-level scaling. Hive features a description frontend that captures per-agent behavior and supports test-time scaling algorithms. Leveraging this specification, our backend introduces two key mechanisms: Logits Cache that reuses intermediate logits across redundant sampling paths to mitigate cross-path redundancy at the algorithm level, and Agent-Aware Scheduling that efficiently allocates compute and KV-cache resources according to agent contributions at the task level. Experiments show that Logits Cache achieves an average speedup of $1.11\times$-$1.76\times$ for re-sampling, and Agent-Aware Scheduling reduces the hotspot miss rate by $33\%$-$51\%$.

多智能体推理优化资源调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。