用预测驱动的强化学习,提前优化数据中心服务链部署。
Proactive SFC Provisioning with Forecast-Driven DRL in Data Centers
- 结合预测与强化学习生成资源数据,训练多模型集成预测
- 延迟敏感服务接受率提升至50%(AR)和45%(工业4.0)
- 适合需低延迟、高稳定性的云游戏、AR等实时应用
服务功能链(SFC)需高效部署虚拟网络功能(VNFs),以满足多样服务需求并保持数据中心(DCs)高资源利用率。传统静态资源分配因流量动态变化常导致资源过剩或不足。为此,本文提出一种融合预测智能与SFC部署的混合深度强化学习(DRL)框架。具体地,利用DRL生成反映资源使用与服务需求的数据集,并用于训练深度学习预测模型。通过Optuna进行超参数优化,选出表现最佳的时空图神经网络、时序图神经网络和长短期记忆模型,构建集成预测系统。该预测结果融入数据中心选择过程,实现兼顾当前与未来资源可用性的主动部署。实验表明,所提方法不仅维持了云游戏、VoIP等资源密集型服务的高接受率,还显著提升延迟敏感类服务的接受率:增强现实(AR)从30%升至50%,工业4.0从30%升至45%。同时,端到端延迟分别降低20.5%(VoIP)、23.8%(视频流)和34.8%(云游戏)。该策略实现了更均衡的资源分配,减少资源争用。
原文摘要 · Abstract (English)
Service Function Chaining (SFC) requires efficient placement of Virtual Network Functions (VNFs) to satisfy diverse service requirements while maintaining high resource utilization in Data Centers (DCs). Conventional static resource allocation often leads to overprovisioning or underprovisioning due to the dynamic nature of traffic loads and application demands. To address this challenge, we propose a hybrid forecast-driven Deep reinforcement learning (DRL) framework that combines predictive intelligence with SFC provisioning. Specifically, we leverage DRL to generate datasets capturing DC resource utilization and service demands, which are then used to train deep learning forecasting models. Using Optuna-based hyperparameter optimization, the best-performing models, Spatio-Temporal Graph Neural Network, Temporal Graph Neural Network, and Long Short-Term Memory, are combined into an ensemble to enhance stability and accuracy. The ensemble predictions are integrated into the DC selection process, enabling proactive placement decisions that consider both current and future resource availability. Experimental results demonstrate that the proposed method not only sustains high acceptance ratios for resource-intensive services such as Cloud Gaming and VoIP but also significantly improves acceptance ratios for latency-critical categories such as Augmented Reality increases from 30% to 50%, while Industry 4.0 improves from 30% to 45%. Consequently, the prediction-based model achieves significantly lower E2E latencies of 20.5%, 23.8%, and 34.8% reductions for VoIP, Video Streaming, and Cloud Gaming, respectively. This strategy ensures more balanced resource allocation, and reduces contention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。