提出新框架让车辆路径求解模型持续学习不遗忘,解决旧任务性能下降问题。
Lifelong Learning with Behavior Consolidation for Vehicle Routing
- 通过行为对齐与决策权重调整,动态固化旧任务知识。
- 在多个规模的车辆路径问题上实现95%以上零样本泛化率。
- 适合需要长期适应新场景的智能物流系统开发人员。
近期神经求解器在学习解决路径规划问题方面表现出色。然而,现有研究主要基于单次训练于预定义的问题分布和规模上,当新任务出现时,通常依赖零样本泛化(可能因任务差异导致表现差)或在新任务上微调(可能引发灾难性遗忘)。本文探索一种新型终身学习范式,用于神经车辆路径求解器,即随时间顺序面对多样分布与规模的任务。求解器需在有效高效学习新任务的同时,保持对先前任务的性能。为此,提出名为终身学习路由机行为固化(LLR-BC)的新框架。其通过以决策为导向的方式,将新任务训练后的求解器行为与缓冲区中历史行为对齐,从而有效固化先验知识。为聚焦关键经验,LLR-BC为置信度较低的决策分配更高固化权重。在带容量限制的车辆路径问题(CVRP)与旅行商问题(TSP)上的大量实验表明,该方法在终身学习设定下可训练高性能神经求解器,有效缓解灾难性遗忘,维持模型可塑性,并提升零样本泛化能力。
原文摘要 · Abstract (English)
Recent neural solvers have demonstrated promising performance in learning to solve routing problems. However, existing studies are primarily based on one-off training on one or a set of predefined problem distributions and scales, i.e., tasks. When a new task arises, they typically rely on either zero-shot generalization, which may be poor due to the discrepancies between the new task and the training task(s), or fine-tuning the pretrained solver on the new task, which possibly leads to catastrophic forgetting of knowledge acquired from previous tasks. This paper explores a novel lifelong learning paradigm for neural VRP solvers, where multiple tasks with diverse distributions and scales arise sequentially over time. Solvers are required to effectively and efficiently learn to solve new tasks while maintaining their performance on previously learned tasks. Consequently, a novel framework called Lifelong Learning Router with Behavior Consolidation (LLR-BC) is proposed. LLR-BC consolidates prior knowledge effectively by aligning behaviors of the solver trained on a new task with the buffered ones in a decision-seeking way. To encourage more focus on crucial experiences, LLR-BC assigns greater consolidated weights to decisions with lower confidence. Extensive experiments on capacitated vehicle routing problems and traveling salesman problems demonstrate LLR-BC's effectiveness in training high-performance neural solvers in a lifelong learning setting, addressing the catastrophic forgetting issue, maintaining their plasticity, and improving zero-shot generalization ability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。