arXiv:2603.10545cs.LG2026-03

用强化学习自动调优任务调度权重,提升集群性能33%。

Learning to Score: Tuning Cluster Schedulers through Reinforcement Learning

  • 通过强化学习动态学习调度评分函数的权重
  • 在实验室环境下平均性能提升33%,优于固定权重和基线
  • 适合需要自适应调度的大规模集群运维人员

在大规模集群中高效分配待处理任务可显著提升集群利用率和任务执行性能。当前集群调度器通常依赖一组评分函数对可用节点进行排序,但各评分函数权重常被均等对待,难以适配不同工作负载特性。手动调优权重需专家经验且计算成本高。本文提出一种基于强化学习的调度权重优化方法,目标是提升集群内任务的整体端到端性能。方法采用相对改进率奖励机制、帧堆叠结构和限制领域信息,以应对多步参数调整问题,并增强在未见集群与工作负载上的泛化能力。策略在多种工作负载与集群配置组合上训练。实验表明,在实验室级无服务器场景中,该方法相比固定权重提升平均性能33%,相比最佳基线提升12%。

原文摘要 · Abstract (English)

Efficiently allocating incoming jobs to nodes in large-scale clusters can lead to substantial improvements in both cluster utilization and job performance. In order to allocate incoming jobs, cluster schedulers usually rely on a set of scoring functions to rank feasible nodes. Results from individual scoring functions are usually weighted equally, which could lead to sub-optimal deployments as the one-size-fits-all solution does not take into account the characteristics of each workload. Tuning the weights of scoring functions, however, requires expert knowledge and is computationally expensive. This paper proposes a reinforcement learning approach for learning the weights in scheduler scoring algorithms with the overall objective of improving the end-to-end performance of jobs for a given cluster. Our approach is based on percentage improvement reward, frame-stacking, and limiting domain information. We propose a percentage improvement reward to address the objective of multi-step parameter tuning. The inclusion of frame-stacking allows for carrying information across an optimization experiment. Limiting domain information prevents overfitting and improves performance in unseen clusters and workloads. The policy is trained on different combinations of workloads and cluster setups. We demonstrate the proposed approach improves performance on average by 33\% compared to fixed weights and 12\% compared to the best-performing baseline in a lab-based serverless scenario.

调度优化强化学习集群管理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。