用Transformer+强化学习动态调优软件定义网络负载,效果显著优于传统方法。
A transformer-based deep q learning approach for dynamic load balancing in software-defined networks
- 用TFT预测流量,DQN根据预测结果实时决策路由。
- 500MB下吞吐率达0.275,比传统方法高30%以上。
- 适合研究智能网络调度或想提升SDN性能的开发者。
本研究提出一种基于Transformer的深度Q网络(DQN)方法,用于软件定义网络(SDN)中的动态负载均衡。传统方法如轮询(RR)和加权轮询(WRR)为静态策略,难以应对流量波动,导致性能下降。本文结合时序融合Transformer(TFT)进行精准流量预测,并利用DQN模型实现实时动态负载均衡。TFT预测未来流量,作为DQN输入以优化路由决策,从而提升吞吐量、降低延迟和丢包率。在不同数据速率的模拟环境中测试,500MB速率下,DQN平均吞吐量达0.275,优于RR的0.202和WRR的0.205;1000MB下同样表现更优。结果表明,该方法能有效提升网络性能,推动基于机器学习的智能网络管理发展。
原文摘要 · Abstract (English)
This study proposes a novel approach for dynamic load balancing in Software-Defined Networks (SDNs) using a Transformer-based Deep Q-Network (DQN). Traditional load balancing mechanisms, such as Round Robin (RR) and Weighted Round Robin (WRR), are static and often struggle to adapt to fluctuating traffic conditions, leading to inefficiencies in network performance. In contrast, SDNs offer centralized control and flexibility, providing an ideal platform for implementing machine learning-driven optimization strategies. The core of this research combines a Temporal Fusion Transformer (TFT) for accurate traffic prediction with a DQN model to perform real-time dynamic load balancing. The TFT model predicts future traffic loads, which the DQN uses as input, allowing it to make intelligent routing decisions that optimize throughput, minimize latency, and reduce packet loss. The proposed model was tested against RR and WRR in simulated environments with varying data rates, and the results demonstrate significant improvements in network performance. For the 500MB data rate, the DQN model achieved an average throughput of 0.275 compared to 0.202 and 0.205 for RR and WRR, respectively. Additionally, the DQN recorded lower average latency and packet loss. In the 1000MB simulation, the DQN model outperformed the traditional methods in throughput, latency, and packet loss, reinforcing its effectiveness in managing network loads dynamically. This research presents an important step towards enhancing network performance through the integration of machine learning models within SDNs, potentially paving the way for more adaptive, intelligent network management systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。