arXiv:2608.04458cs.AIcs.AR2026-08被引 2

Agentic AI让服务器资源调度更复杂,需针对性设计新架构。

Architectural Implications of Agentic AI Workflows

论文配图:Architectural Implications of Agentic AI Workflows
图 1 · 摘自论文原文
  • 将智能体工作流分类,揭示其跨CPU-GPU频繁切换的碎片化特性。
  • 传统服务器在突发负载下出现CPU/GPU闲置,利用率低至20%以下。
  • 适合关注AI基础设施优化、系统设计的研究者与工程师。

智能体型AI正进入数据中心,但其架构影响尚不明确。本文通过微软Azure的生产调研和开源框架的受控实验,首次对智能体工作流进行分类并构建架构特征模型。研究发现,智能体执行过程高度碎片化且异构:请求演变为包含大模型推理、工具调用和编排决策的工作流,反复跨越CPU-GPU边界。编排与工具运行于主机,导致CPU成为关键路径。执行结构造成负载随时间波动,整体利用率低而峰值突发;模型组合影响GPU使用均匀性,任务与工具多样性进一步扩大波动范围。这些特性暴露了传统统一服务器架构的适配缺陷:碎片化执行导致即使在突发需求下仍存在资源空置;不同软件角色使同质化CPU配置效率低下;多智能体共享核心破坏微架构局部性。基于此,我们提出Agora原型系统,采用动态回收空闲CPU核心以支持共置吞吐任务,同时保障智能体尾延迟不受工具调用冲击;通过超额订阅GPU内存,预取下一智能体状态以隐藏交换延迟;按角色分池核心并实施亲和性调度,恢复局部性;自动调节机制以适应负载。Agora在提升资源利用率和服务器吞吐量的同时,保持智能体尾延迟稳定。研究为未来智能体专用服务器架构提供了关键方向。

原文摘要 · Abstract (English)

Agentic AI is emerging in datacenters, but its architectural implications remain unexplored. We organize agentic workflows in a taxonomy and present its first architectural characterization with a production study at Microsoft Azure and a controlled study of open-source frameworks. We show that agentic execution is fragmented and heterogeneous. Requests expand into a workflow of LLM inferences, tool invocations, and orchestration decisions that repeatedly cross the CPU-GPU boundary. Our taxonomy explains how this fragmentation turns into resource demand. As orchestration and tools run on the host, the CPU sits on the critical path. Execution structure sets the load over time, which stays low with sudden spikes. Model composition sets how evenly the workflow uses the GPUs. Diversity in tasks and tools widens this range even further. These characteristics expose architectural mismatches of conventional uniform servers. Fragmented execution strands CPU and GPU capacity despite bursty demand. Different software roles make homogeneous CPU provisioning inefficient. Finally, multiplexing many agents onto shared cores degrades microarchitectural locality. Guided by our findings, we derive implications for agentic servers and examine them through Agora, our prototype for commodity servers. Agora dynamically harvests idle CPU cores for co-located throughput work, while protecting agentic tail latency against tool spikes. It oversubscribes GPU memory by placing more agents on each GPU, prefetching the next agent's state to hide swap latency. To match the machine to the heterogeneous roles, Agora pools cores by role and applies affinity-aware scheduling to restore locality. It automatically tunes mechanisms to the workload. Agora improves utilization and server throughput while preserving agent tail latency. Our insights also identify key directions for future server architectures for agentic AI.

智能体系统架构资源调度性能优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。