提出可自适应组合专家模块的模型,提升路径规划在真实场景中的泛化能力。
Towards Generalization-Oriented Models for Vehicle Routing Problems with Mixture-of-Experts

- 将策略网络拆分为多个专家模块,通过实例级门控动态选择组合
- 在合成与真实数据上均优于现有方法,跨分布性能显著提升
- 适合需要强泛化能力的物流路径优化场景
近年来,深度强化学习(DRL)在车辆路径问题(VRPs)上取得显著进展。然而,现有DRL方法通常在均匀分布生成的实例上训练,限制了其在真实分布偏移下的表现。本文旨在构建面向泛化的模型,将策略网络划分为多个模块,并在推理时自适应重组形成特定策略。我们提出残差精炼专家与实例级门控(R2E-IG),以提升跨分布泛化能力。主要贡献包括:(1) 提出残差精炼专家(R2E)架构,通过残差精炼增强专家表达能力;(2) 设计实例级门控机制,学习分布感知的实例表示并引导输入至合适模块;(3) 提出混合分布训练机制,结合动态权重适配(DWA),动态重加权不同分布的训练数据,突出更具信息量的数据。大量实验表明,R2E-IG在合成与基准数据集上的分布内与分布外实例中均达到领先性能。此外,R2E-IG具有通用性,可无缝集成到现有DRL方法中进一步提升效果。
原文摘要 · Abstract (English)
In recent years, Deep Reinforcement Learning (DRL) has achieved substantial progress on Vehicle Routing Problems (VRPs). However, existing DRL-based methods are typically trained on instances generated from a uniform distribution, which limits their performance under real-world distribution shifts. In this paper, we aim to develop a generalization-oriented model that partitions the policy network into multiple modules and adaptively recombines modules to form specific policies during inference. Specifically, we propose Residual Refined Experts with Instance-level Gating (R2E-IG) to improve cross-distribution generalization. Our contributions are threefold: (1) We introduce a Residual Refined Expert (R2E) architecture that enhance expert expressiveness via residual refinement; (2) We design an instance-level gating mechanism that learns distribution-aware instance representations and routes inputs to suitable modules; (3) We propose a mixed-distribution training mechanism equipped with Dynamic Weight Adaption (DWA), which dynamically reweights training data from different distributions to emphasize more informative ones. Extensive experiments show that R2E-IG achieves competitive performance against state-of-the-art baselines on both in-distribution and out-of-distribution instances across synthetic and benchmark datasets. Moreover, R2E-IG is generic and can be easily integrated into existing DRL-based methods to further improve performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。