Geminet用轻量迭代法解决动态网络的流量调度问题。
Geminet: Learning the Duality-based Iterative Process for Lightweight Traffic Engineering in Changing Topologies
- 用梯度迭代代替路径路由,降低对拓扑的依赖。
- 神经网络仅占现有方案0.04%~7%,内存低于10GiB。
- 适合大规模网络部署,收敛速度是HARP的5.45倍。
近年来,研究人员探索了基于机器学习的流量工程(TE),利用神经网络解决传统上由优化方法处理的TE问题。然而,现有的基于ML的TE方案仍不实用:要么无法应对拓扑变化,要么因计算和内存开销过大而可扩展性差。为克服这些局限,我们提出Geminet,一种轻量且可扩展的基于ML的TE框架,能够处理动态拓扑。Geminet基于两个关键洞察:(i) 通过解耦神经网络与拓扑,学习一种基于梯度下降的迭代调整过程,因为梯度下降的更新规则与拓扑无关,仅依赖少量梯度相关量;(ii) 将优化从路径级路由权重转移到边级对偶变量,利用边的数量远少于路径的特点,显著降低内存消耗。在广域网和数据中心数据集上的评估表明,Geminet显著提升了可扩展性。其神经网络规模仅为现有方案的0.04%至7%,同时在处理拓扑变化时效果与HARP(最先进的ML-based TE方法)相当,无性能下降。在大规模拓扑上训练时,Geminet内存消耗低于10 GiB,远低于HARP所需的80多GiB,且收敛速度提升5.45倍,展现出大规模部署的潜力。
原文摘要 · Abstract (English)
Recently, researchers have explored ML-based Traffic Engineering (TE), leveraging neural networks to solve TE problems traditionally addressed by optimization. However, existing ML-based TE schemes remain impractical: they either fail to handle topology changes or suffer from poor scalability due to excessive computational and memory overhead. To overcome these limitations, we propose Geminet, a lightweight and scalable ML-based TE framework that can handle changing topologies. Geminet is built upon two key insights: (i) a methodology that decouples neural networks from topology by learning an iterative gradient-descent-based adjustment process, as the update rule of gradient descent is topology-agnostic, relying only on a few gradient-related quantities; (ii) shifting optimization from path-level routing weights to edge-level dual variables, reducing memory consumption by leveraging the fact that edges are far fewer than paths. Evaluations on WAN and data center datasets show that Geminet significantly improves scalability. Its neural network size is only 0.04% to 7% of existing schemes, while handling topology variations as effectively as HARP, a state-of-the-art ML-based TE approach, without performance degradation. When trained on large-scale topologies, Geminet consumes under 10 GiB of memory, more than eight times less than the 80-plus GiB required by HARP, while achieving 5.45 times faster convergence speed, demonstrating its potential for large-scale deployment.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。