arXiv:2603.12031cs.DCcs.LG2026-03

用多智能体强化学习优化K8s调度,平衡成本、容错与资源利用率。

Agentic-Kube: A Graph-Enhanced Multi-Agent Reinforcement Learning Framework for Multi-Objective Kubernetes Scheduling

  • 拆分调度目标为三个专用智能体,分别负责成本、容错和资源分配
  • 在真实集群中实现7.11%的服务故障碰撞率,比默认调度器降低53%
  • 支持千节点扩展,决策延迟低于17ms,适合高并发生产环境

云原生容器编排需要能平衡基础设施开销、故障容错和节点利用率的资源调度器。传统强化学习方法依赖单一智能体模型,在映射冲突目标时易出现梯度干扰和奖励稀释问题。我们提出Agentic-Kube,一个面向实时Kubernetes Pod调度的协作式多智能体强化学习框架。该架构将多目标调度分解为由三个专用子智能体管理的三元优化空间:成本最小化、反亲和性容错和向量资源均衡。Agentic-Kube集成双部分图卷积网络以捕捉动态主机-Pod依赖关系,采用两阶段单调QMIX值分解网络保持联合动作价值一致性,并引入多数投票共识机制与动作可行性掩码,防止违反可分配节点约束。我们在真实异构Google Kubernetes Engine部署及覆盖50至1000节点的宏观集群环境中进行评估,基于阿里云实测数据、昼夜微服务变化和突发流量场景。在物理与仿真测试中,Agentic-Kube始终实现帕累托高效调度。在昼夜微服务负载下,反亲和性服务碰撞率降至7.11%,相对默认调度器降低53.0%;在阿里云数据集上,策略实现65.15%的预付费实例分配率;宏规模基准测试表明,系统可扩展至1000节点,平均决策延迟低于17ms,99百分位延迟低于31ms,无容器重启失败,且运行在标准调度准入超时之内。

原文摘要 · Abstract (English)

Cloud-native container orchestration requires resource schedulers capable of balancing infrastructure expenditure, fault resilience, and node utilisation. Conventional reinforcement learning approaches typically rely on monolithic single-agent models that suffer from gradient interference and reward dilution when mapping conflicting operational goals into a single scalar reward. We present Agentic-Kube, a cooperative multi-agent reinforcement learning framework designed for real-time Kubernetes pod placement. The architecture decomposes multi-objective scheduling into a tripartite optimisation space managed by dedicated sub-agents for cost minimisation, anti-affinity fault tolerance, and vector resource balancing. Agentic-Kube integrates a bipartite Graph Convolutional Network to capture dynamic host-pod dependencies, a two-stage monotonic QMIX value factorisation network to maintain joint action value coherence, and a plurality voting consensus mechanism with action feasibility masking against allocatable node predicates. We evaluate the framework across live heterogeneous Google Kubernetes Engine deployments and macro-scale cluster environments spanning 50 to 1,000 nodes under empirical Alibaba trace data, diurnal microservice variations, and flash-crowd bursts. Across physical and simulated evaluations, Agentic-Kube consistently achieves Pareto-efficient placements. In diurnal microservice workloads, it reduces anti-affinity service collisions to 7.11%, representing a 53.0% relative reduction compared to the default Kubernetes scheduler. Under Alibaba traces, the policy achieves a 65.15% spot instance allocation ratio, while macro-scale benchmarks demonstrate scaling up to 1,000 nodes with mean decision latencies under 17ms and 99th-percentile latencies under 31ms, executing without container restart failures and operating well within standard scheduling admission timeouts.

K8s调度多智能体强化学习资源优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。