让复杂AI系统更省资源,自动调度不降质。
Towards Resource-Efficient Compound AI Systems
- 用声明式流程编程解耦逻辑与执行细节
- 运行时动态调度,完成时间快3.4倍,能效高4.5倍
- 适合构建高效智能体或自动化工作流的开发者
复合型AI系统通过整合多个相互协作的组件(如模型、检索器和外部工具)来应对复杂任务。然而,现有实现因应用逻辑与执行细节紧密耦合、编排层与资源管理层脱节,以及效率与质量被视为互斥,导致资源利用效率低下。本文提出一种资源高效的复合型AI系统愿景,采用声明式工作流编程模型与自适应运行时系统,实现动态调度与资源感知决策。解耦应用逻辑与底层细节,使运行时可灵活配置执行环境和资源,不牺牲质量。实现编排与集群管理协同,提升调度与资源管理效率。我们正在构建名为Murakkab的原型系统。初步评估显示,工作流完成时间最快提升约3.4倍,能效提高约4.5倍,展现出优化资源与推动AI系统设计的潜力。
原文摘要 · Abstract (English)
Compound AI Systems, integrating multiple interacting components like models, retrievers, and external tools, have emerged as essential for addressing complex AI tasks. However, current implementations suffer from inefficient resource utilization due to tight coupling between application logic and execution details, a disconnect between orchestration and resource management layers, and the perceived exclusiveness between efficiency and quality. We propose a vision for resource-efficient Compound AI Systems through a declarative workflow programming model and an adaptive runtime system for dynamic scheduling and resource-aware decision-making. Decoupling application logic from low-level details exposes levers for the runtime to flexibly configure the execution environment and resources, without compromising on quality. Enabling collaboration between the workflow orchestration and cluster manager enables higher efficiency through better scheduling and resource management. We are building a prototype system, called Murakkab, to realize this vision. Our preliminary evaluation demonstrates speedups up to $\sim 3.4\times$ in workflow completion times while delivering $\sim 4.5\times$ higher energy efficiency, showing promise in optimizing resources and advancing AI system design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。