arXiv:2508.03509cs.LG2025-08ICML被引 5

智能分配算力,让训练快、省钱还守约。

SLA-MORL: SLA-Aware Multi-Objective Reinforcement Learning for HPC Resource Optimization

  • 用多目标强化学习动态分配资源,自动平衡速度、成本和承诺
  • 冷启动问题减少60%,关键任务提速67.2%,预算任务降本68.8%
  • 适合云平台运维、大规模训练调度的工程师和研究者

云端机器学习工作负载的动态资源分配仍面临挑战:如何在缩短训练时间与降低运营成本的同时满足服务等级协议(SLA)约束。传统方法采用静态分配或单目标优化,导致常出现SLA违约或资源浪费。本文提出SLA-MORL,一种自适应多目标强化学习框架,根据用户偏好(时间、成本或均衡)智能分配GPU与CPU资源,并确保SLA合规。核心创新包括:(1) 通过历史学习或高效基线运行实现智能初始化,消除冷启动问题,将初始探索开销降低60%;(2) 动态权重调整机制,根据实时SLA违规严重程度自动调节优化优先级,形成自校正系统。该方法构建21维状态表示,涵盖资源利用率、训练进度与SLA合规性,支持9种动作选择。在13个多样化机器学习工作负载上,基于真实高性能计算基础设施的评估显示,相比静态基线,SLA-MORL使限期任务训练时间减少67.2%,预算受限任务成本降低68.8%,整体SLA合规率提升73.4%。该方案有效解决了冷启动低效与动态适应难题,为现代机器学习训练环境提供兼顾性能、成本与可靠性的实用资源管理方案。

原文摘要 · Abstract (English)

Dynamic resource allocation for machine learning workloads in cloud environments remains challenging due to competing objectives of minimizing training time and operational costs while meeting Service Level Agreement (SLA) constraints. Traditional approaches employ static resource allocation or single-objective optimization, leading to either SLA violations or resource waste. We present SLA-MORL, an adaptive multi-objective reinforcement learning framework that intelligently allocates GPU and CPU resources based on user-defined preferences (time, cost, or balanced) while ensuring SLA compliance. Our approach introduces two key innovations: (1) intelligent initialization through historical learning or efficient baseline runs that eliminates cold-start problems, reducing initial exploration overhead by 60%, and (2) dynamic weight adaptation that automatically adjusts optimization priorities based on real-time SLA violation severity, creating a self-correcting system. SLA-MORL constructs a 21-dimensional state representation capturing resource utilization, training progress, and SLA compliance, enabling an actor-critic network to make informed allocation decisions across 9 possible actions. Extensive evaluation on 13 diverse ML workloads using production HPC infrastructure demonstrates that SLA-MORL achieves 67.2% reduction in training time for deadline-critical jobs, 68.8% reduction in costs for budget-constrained workloads, and 73.4% improvement in overall SLA compliance compared to static baselines. By addressing both cold-start inefficiency and dynamic adaptation challenges, SLA-MORL provides a practical solution for cloud resource management that balances performance, cost, and reliability in modern ML training environments.

资源优化强化学习云平台多目标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。