用语言模型设计可解释的虚拟机调度策略,提升云环境适应性。
Learning Virtual Machine Scheduling in Cloud Computing through Language Agents

- 构建分层语言代理框架,将调度问题建模为带选项的半马尔可夫决策过程。
- 在超万级虚拟机场景下实现96.9%的竞争比,支持非平稳请求流。
- 适用于需要高可解释性与强泛化能力的大型云平台调度任务。
在云服务中,虚拟机(VM)调度是一个典型的在线动态多维装箱问题(ODMBP),具有大规模复杂性和需求波动性。传统优化方法难以适应实时变化,领域专家设计的启发式策略僵化,现有学习方法又普遍缺乏泛化性和可解释性。为此,本文提出一种分层语言代理框架MiCo,以大语言模型(LLM)驱动的启发式设计范式求解ODMBP。具体地,将ODMBP建模为带选项的半马尔可夫决策过程(SMDP-Option),采用两阶段架构:选项挖掘器(Option Miner)利用LLM与构建环境交互,发现多样且有效的非上下文感知策略;选项组合器(Option Composer)则利用LLM发现将非上下文策略与上下文策略融合的组合策略。在真实企业数据集上的大量实验表明,MiCo在涉及超过10,000台虚拟机的大规模场景中实现了96.9%的竞争比,即使在非平稳请求流和多样化配置下仍保持高性能,验证了其在复杂、大规模云环境中的有效性。
原文摘要 · Abstract (English)
In cloud services, virtual machine (VM) scheduling is a typical Online Dynamic Multidimensional Bin Packing (ODMBP) problem, characterized by large-scale complexity and fluctuating demands. Traditional optimization methods struggle to adapt to real-time changes, domain-expert-designed heuristic approaches suffer from rigid strategies, and existing learning-based methods often lack generalizability and interpretability. To address these limitations, this paper proposes a hierarchical language agent framework named MiCo, which provides a large language model (LLM)-driven heuristic design paradigm for solving ODMBP. Specifically, ODMBP is formulated as a Semi-Markov Decision Process with Options (SMDP-Option), enabling dynamic scheduling through a two-stage architecture, i.e., Option Miner and Option Composer. Option Miner utilizes LLMs to discover diverse and useful non-context-aware strategies by interacting with constructed environments. Option Composer employs LLMs to discover a composing strategy that integrates the non-context-aware strategies with the contextual ones. Extensive experiments on real-world enterprise datasets demonstrate that MiCo achieves a 96.9\% competitive ratio in large-scale scenarios involving more than 10,000 virtual machines. It maintains high performance even under nonstationary request flows and diverse configurations, thus validating its effectiveness in complex and large-scale cloud environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。