用分层专家系统让路由模型兼顾局部细节与全局结构,提升稀疏网络下的路径选择精度。
Bridging Local and Global Knowledge: Cascaded Mixture-of-Experts Learning for Near-Shortest Path Routing
- 分两层设计专家网络:底层用局部特征,顶层在必要时启用全局特征。
- 稀疏网络下准确率比单专家模型高29.1%,且性能接近理论最优上限。
- 支持在线微调与防遗忘机制,适合动态变化的复杂网络环境。
尽管基于局部特征的深度学习模型在稠密欧几里得图中展现出近优路由潜力,但在拓扑不规则的稀疏网络中泛化能力不足。为此,我们提出级联专家混合模型(Ca-MoE)解决全对近最短路径(APNSP)路由问题。该模型采用模块化双层架构,底层专家依赖局部特征进行转发决策,上层专家在底层不足以保证决策质量时才被触发。通过自适应推理机制,在拓扑复杂时才提升模型容量,避免参数冗余,实现高效计算。同时引入在线元学习策略,支持独立专家微调,并采用稳定性导向更新机制防止新图环境下灾难性遗忘。实验表明,Ca-MoE在稀疏网络中准确率相较单专家基线最高提升29.1%,且在不同图密度下性能维持在理论最优值的1%-6%范围内。
原文摘要 · Abstract (English)
While deep learning models that leverage local features have demonstrated significant potential for near-optimal routing in dense Euclidean graphs, they struggle to generalize well in sparse networks where topological irregularities require broader structural awareness. To address this limitation, we train a Cascaded Mixture of Experts (Ca-MoE) to solve the all-pairs near-shortest path (APNSP) routing problem. Our Ca-MoE is a modular two-tier architecture that supports the decision-making for forwarder selection with lower-tier experts relying on local features and upper-tier experts relying on global features. It performs adaptive inference wherein the upper-tier experts are triggered only when the lower-tier ones do not suffice to achieve adequate decision quality. Computational efficiency is thus achieved by escalating model capacity only when necessitated by topological complexity, and parameter redundancy is avoided. Furthermore, we incorporate an online meta-learning strategy that facilitates independent expert fine-tuning and utilizes a stability-focused update mechanism to prevent catastrophic forgetting as new graph environments are encountered. Experimental evaluations demonstrate that Ca-MoE routing improves accuracy by up to 29.1% in sparse networks compared to single-expert baselines and maintains performance within 1%-6% of the theoretical upper bound across diverse graph densities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。