用大模型主动思考优化路径,让算法自动生成更优解法。
PyVRP$^+$: LLM-Driven Metacognitive Heuristic Evolution for Hybrid Genetic Search in Vehicle Routing Problems
- 让大模型通过反思与推理设计新启发式策略
- 在复杂路劲问题上提升解质量2.7%,提速超45%
- 适合想自动优化组合优化算法的研究者
为解决车辆路径问题(VRP)等难解组合优化问题,设计高性能元启发式算法仍面临挑战,通常需大量领域知识和人工调参。近期研究展示大语言模型(LLM)可通过演化搜索自动化这一过程。然而现有方法多为被动响应,仅根据即时性能反馈进行代码突变。本文提出元认知演化编程(MEP),将LLM升级为战略发现代理。不再仅依赖性能反馈,MEP促使LLM执行“推理-行动-反思”循环,显式诊断失败原因、提出设计假设,并基于预设领域知识实施改进。通过应用MEP演化前沿混合遗传搜索(HGS)算法的核心组件,我们发现了显著优于原基线的新型启发式策略。通过引导LLM战略性地权衡探索与利用,该方法在多种VRP变体中发现更高效、有效的启发式算法。实验表明,所发现的启发式使解决方案质量最高提升2.70%,在困难的VRP实例上运行时间减少超过45%。
原文摘要 · Abstract (English)
Designing high-performing metaheuristics for NP-hard combinatorial optimization problems, such as the Vehicle Routing Problem (VRP), remains a significant challenge, often requiring extensive domain expertise and manual tuning. Recent advances have demonstrated the potential of large language models (LLMs) to automate this process through evolutionary search. However, existing methods are largely reactive, relying on immediate performance feedback to guide what are essentially black-box code mutations. Our work departs from this paradigm by introducing Metacognitive Evolutionary Programming (MEP), a framework that elevates the LLM to a strategic discovery agent. Instead of merely reacting to performance scores, MEP compels the LLM to engage in a structured Reason-Act-Reflect cycle, forcing it to explicitly diagnose failures, formulate design hypotheses, and implement solutions grounded in pre-supplied domain knowledge. By applying MEP to evolve core components of the state-of-the-art Hybrid Genetic Search (HGS) algorithm, we discover novel heuristics that significantly outperform the original baseline. By steering the LLM to reason strategically about the exploration-exploitation trade-off, our approach discovers more effective and efficient heuristics applicable across a wide spectrum of VRP variants. Our results show that MEP discovers heuristics that yield significant performance gains over the original HGS baseline, improving solution quality by up to 2.70\% and reducing runtime by over 45\% on challenging VRP variants.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。