用大模型生成更真实的路径规划数据,提升神经网络对现实问题的求解能力。
Bridging Synthetic and Real Routing Problems via LLM-Guided Instance Generation and Progressive Adaptation
- 用大语言模型指导进化算法生成结构真实多样的合成数据
- 在TSPLib和CVRPLib上使求解误差分别降至1.05%和2.71%
- 适合想提升神经优化模型泛化能力的研究者
神经组合优化(NCO)方法在处理合成路径规划问题上已取得显著进展,但现有模型难以从均匀分布的合成数据泛化到真实世界车辆路径问题(VRP),包括经典的TSPLib和CVRPLib基准。为此,本文提出进化式真实实例生成方法(EvoReal),利用大语言模型(LLM)引导的进化模块生成具有多样且真实结构特征的合成实例,其结构属性与真实数据统计一致。随后,预训练的NCO模型先在这些结构丰富化的合成数据上逐步优化,再在真实基准实例上进行微调。大量实验表明,EvoReal显著提升了先进神经求解器的泛化能力,在多个问题规模下,相较于最优解的性能差距在TSPLib上降低至1.05%,在CVRPLib上降低至2.71%。
原文摘要 · Abstract (English)
Recent advances in Neural Combinatorial Optimization (NCO) methods have significantly improved the capability of neural solvers to handle synthetic routing instances. Nonetheless, existing neural solvers typically struggle to generalize effectively from synthetic, uniformly-distributed training data to real-world VRP scenarios, including widely recognized benchmark instances from TSPLib and CVRPLib. To bridge this generalization gap, we present Evolutionary Realistic Instance Synthesis (EvoReal), which leverages an evolutionary module guided by large language models (LLMs) to generate synthetic instances characterized by diverse and realistic structural patterns. Specifically, the evolutionary module produces synthetic instances whose structural attributes statistically mimics those observed in authentic real-world instances. Subsequently, pre-trained NCO models are progressively refined, firstly aligning them with these structurally enriched synthetic distributions and then further adapting them through direct fine-tuning on actual benchmark instances. Extensive experimental evaluations demonstrate that EvoReal markedly improves the generalization capabilities of state-of-the-art neural solvers, yielding a notable reduced performance gap compared to the optimal solutions on the TSPLib (1.05%) and CVRPLib (2.71%) benchmarks across a broad spectrum of problem scales.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。