提出新调度算法,在多地数据中心中降低电费,同时满足任务截止时间。
Electricity Cost Minimization for Multi-Workflow Allocation in Geo-Distributed Data Centers
- 设计四阶段调度流程,结合图嵌入与策略网络优化决策。
- 相比现有方法,电费降低超15%,计算耗时可控。
- 适合研究数据中心调度或电力成本优化的开发者参考。
全球范围内的地理分布式数据中心(GDCs)为海量工作流应用提供计算与存储服务,导致电力成本高昂且随地理位置和时段动态变化。如何在满足工作流任务截止时间的前提下降低电力成本,成为关键挑战,这取决于服务器执行时间、功耗及电价。由于不同服务器频率下工作流完成时间难以精确估算,尤其在异构资源环境下更为复杂;同时,电价在不同地区存在差异且实时变动。为此,本文构建了地理分布式系统架构,并提出一种面向固定频率与功耗服务器的电力成本感知多工作流调度算法(ECMWS)。该算法包含工作流排序、截止时间划分、任务排序与资源分配四个阶段,采用两个图嵌入模型与一个策略网络求解马尔可夫决策过程(MDP)。通过对大量工作流实例进行参数与组件的统计校准后,与当前最优方法在两类工作流实例上对比。实验表明,所提算法显著优于其他方法,电力成本降低超过15%,同时保持可接受的计算开销。源代码已公开于 https://gitee.com/public-artifacts/ecmws-experiments。
原文摘要 · Abstract (English)
Worldwide, Geo-distributed Data Centers (GDCs) provide computing and storage services for massive workflow applications, resulting in high electricity costs that vary depending on geographical locations and time. How to reduce electricity costs while satisfying the deadline constraints of workflow applications is important in GDCs, which is determined by the execution time of servers, power, and electricity price. Determining the completion time of workflows with different server frequencies can be challenging, especially in scenarios with heterogeneous computing resources in GDCs. Moreover, the electricity price is also different in geographical locations and may change dynamically. To address these challenges, we develop a geo-distributed system architecture and propose an Electricity Cost aware Multiple Workflows Scheduling algorithm (ECMWS) for servers of GDCs with fixed frequency and power. ECMWS comprises four stages, namely workflow sequencing, deadline partitioning, task sequencing, and resource allocation where two graph embedding models and a policy network are constructed to solve the Markov Decision Process (MDP). After statistically calibrating parameters and algorithm components over a comprehensive set of workflow instances, the proposed algorithms are compared with the state-of-the-art methods over two types of workflow instances. The experimental results demonstrate that our proposed algorithm significantly outperforms other algorithms, achieving an improvement of over 15\% while maintaining an acceptable computational time. The source codes are available at https://gitee.com/public-artifacts/ecmws-experiments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。