用分层多智能体系统实现云原生自动扩缩容,兼顾成本与性能。
MAS-H2: A Hierarchical Multi-Agent System for Holistic Cloud-Native Autoscaling
- 分三层:战略、规划、执行智能体协同决策
- 预测性调度使CPU使用率稳定在40%以下,比原生高50%以上
- 支持零宕机迁移,适合高负载场景的稳定性需求
云原生平台如Kubernetes中的自动扩缩容是反应式且基于指标的,导致高层业务策略与底层资源分配脱节,引发‘战略空白’问题。这种脱节加上容器和节点扩缩容的碎片化协调,会在动态负载下造成严重资源浪费和性能下降。本文提出MAS-H2,一种分层多智能体系统,提供完整的自主云资源管理解决方案。该系统将控制问题分解为三个层级:战略智能体将成本与性能等业务策略转化为全局效用函数;规划智能体通过时间序列预测生成容器与节点的联合主动扩缩计划;执行智能体负责落地执行。我们在Google Kubernetes Engine(GKE)上构建并测试了MAS-H2原型,对比原生的水平Pod自动扩缩器(HPA)和集群自动扩缩器(CA)。在两个真实、突发性强、压力大的工作负载场景下,对于可预测的心跳类负载,MAS-H2将应用CPU使用率维持在40%以下,持续CPU压力比原生HPA低50%以上(后者通常超过80%)。在动荡的混沌闪购场景中,系统通过过滤瞬时噪声,部署更多副本,将峰值CPU负载降低55%,且未出现资源不足。此外,系统还实现了在两种优化不同方向的基础设施间进行零停机的战略迁移。
原文摘要 · Abstract (English)
Autoscaling in cloud-native platforms like Kubernetes is reactive and metric-driven, leading to a strategic void problem. This comes from the decoupling of higher-level business policies from lower-level resource provisioning. The strategic void, coupled with a fragmented coordination of pod and node scaling, can lead to significant resource waste and performance degradation under dynamic workloads. In this paper, we present MAS-H2, a new hierarchical multi-agent system that addresses the challenges of autonomic cloud resource management with a complete end-to-end solution. MAS-H2 systematically decomposes the control problem into three layers: a Strategic Agent that formalises business policies (e.g., cost vs. performance) into a global utility function; Planning Agents that produce a joint, proactive scaling plan for pods and nodes with time-series forecasting; and Execution Agents that execute the scaling plan. We built and tested a MAS-H2 prototype as a Kubernetes Operator on Google Kubernetes Engine (GKE) to benchmark it against the native Horizontal Pod Autoscaler (HPA) and Cluster Autoscaler (CA) baselines under two realistic, spiky, and stress-inducing workload scenarios. The results show that the MAS-H2 system maintained application CPU usage under 40% for predictable Heartbeat workloads. This resulted in over 50% less sustained CPU stress than the native HPA baseline, which typically operated above 80%. The MAS-H2 system demonstrated proactive planning in a volatile Chaotic Flash Sale scenario by filtering transient noise and deploying more replicas compared to HPA. It reduced peak CPU load by 55% without under-provisioning. Beyond performance, MAS-H2 seamlessly performed a zero-downtime strategic migration between two cost- and performance-optimised infrastructures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。