arXiv:2506.02935cs.LG2025-06NeurIPS被引 12

用知识蒸馏训练通用车辆路径求解器,提升大规模问题的泛化能力。

MTL-KD: Multi-Task Learning Via Knowledge Distillation for Generalizable Neural Vehicle Routing Solver

  • 通过知识蒸馏将多个单任务强化学习模型的知识迁移到一个重型解码器中
  • 在最多1000个节点的6种已见和10种未见车辆路径问题上表现更优
  • 适合需要处理多种复杂路径优化场景的研究者与工业应用

神经组合优化中的多任务学习(MTL)是一种有前景的方法,可训练统一模型以解决多种车辆路径问题(VRP)变体。然而,现有基于强化学习(RL)的多任务方法仅能在小规模问题上训练轻量解码器,对大规模问题泛化能力有限。为此,本文提出一种基于知识蒸馏的新型多任务学习方法(MTL-KD),可高效训练具备强泛化能力的重型解码器模型。该方法将多个不同RL单任务模型的策略知识迁移至单一重型解码器,实现无标签训练,并显著提升模型在多样化任务间的泛化性能。此外,我们设计了一种灵活的推理策略——随机重排重构(R3C),专门适配多样化的VRP任务,进一步提升多任务模型性能。在包含6种已见和10种未见VRP变体、最多1000个节点的问题上,实验表明本方法在均匀和真实世界基准上均持续取得更优表现,验证了其强大的泛化能力。

原文摘要 · Abstract (English)

Multi-Task Learning (MTL) in Neural Combinatorial Optimization (NCO) is a promising approach to train a unified model capable of solving multiple Vehicle Routing Problem (VRP) variants. However, existing Reinforcement Learning (RL)-based multi-task methods can only train light decoder models on small-scale problems, exhibiting limited generalization ability when solving large-scale problems. To overcome this limitation, this work introduces a novel multi-task learning method driven by knowledge distillation (MTL-KD), which enables the efficient training of heavy decoder models with strong generalization ability. The proposed MTL-KD method transfers policy knowledge from multiple distinct RL-based single-task models to a single heavy decoder model, facilitating label-free training and effectively improving the model's generalization ability across diverse tasks. In addition, we introduce a flexible inference strategy termed Random Reordering Re-Construction (R3C), which is specifically adapted for diverse VRP tasks and further boosts the performance of the multi-task model. Experimental results on 6 seen and 10 unseen VRP variants with up to 1000 nodes indicate that our proposed method consistently achieves superior performance on both uniform and real-world benchmarks, demonstrating robust generalization abilities.

多任务学习车辆路径知识蒸馏组合优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。