arXiv:2508.18298cs.MAcs.AI2025-08被引 24

让智能体工作流更省资源,自动优化模型与硬件匹配。

Murakkab: Resource-Efficient Agentic Workflow Orchestration in Cloud Platforms

  • 用声明式抽象解耦流程定义与执行配置
  • 实测降低GPU使用2.8倍、能耗3.7倍、成本4.3倍
  • 适合需要高效部署复杂AI工作流的云平台用户

智能体工作流通过协调多个模型和工具实现复杂控制逻辑,正成为主流AI应用范式。但当前框架在服务时效率低下,核心问题是将工作流暴露为模型与工具调用的不透明序列,导致代理逻辑与模型及硬件选择紧密耦合。组件常分散于不同实体,系统无法跨准确率、延迟、能耗和成本权衡。这造成资源浪费并影响服务等级目标(SLO)。本文提出Murakkab,一种资源高效的智能体工作流服务系统。它引入声明式抽象,分离工作流规范与执行配置;通过基于性能分析的优化器与自适应运行时协同管理全栈:调度组件、映射至模型与硬件,并动态重构执行以满足用户定义的SLO。通过揭示智能体工作流内部结构,实现现有框架与云调度器无法达成的跨层优化。在多种工作流上的评估表明,Murakkab可将GPU使用减少最多2.8倍、能耗降低3.7倍、成本下降4.3倍,同时保持SLO达标。

原文摘要 · Abstract (English)

Agentic workflows commonly coordinate multiple models and tools with complex control logic. They are quickly becoming the dominant paradigm for AI applications. However, serving them remains inefficient with today's frameworks. The key problem is that they expose workflows as opaque sequences of model and tool calls that tightly couple agent logic with model and hardware choices. Often, these workflow components are fragmented across different entities, preventing systems from reasoning about trade-offs across accuracy, latency, energy, and cost. This leads to resource waste and degraded service-level objectives (SLOs). We present Murakkab, a resource-efficient serving system for agentic workflows. Murakkab introduces a declarative abstraction that decouples workflow specification from execution configuration. A profile-guided optimizer and adaptive runtime jointly manage the full stack: orchestrating workflow components, mapping them to models and hardware, and dynamically reconfiguring execution to satisfy user-defined SLOs. By exposing the internal structure of agentic workflows, Murakkab enables cross-layer optimization that existing frameworks and cloud schedulers cannot achieve. Our evaluation on diverse workflows shows that Murakkab reduces GPU usage by up to 2.8$\times$, energy consumption by 3.7$\times$, and cost by 4.3$\times$ while maintaining SLOs.

智能体工作流资源优化云平台动态调度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。