arXiv:2607.28135cs.LG2026-07

用在线模仿学习训练实例级语言模型,提升组合优化求解效果。

LM-GRASP: Instance-Specific Language Models for Combinatorial Construction via Online Imitation Learning

论文配图:LM-GRASP: Instance-Specific Language Models for Combinatorial Construction via Online Imitation Learning
图 1 · 摘自论文原文
  • 将GRASP构造阶段转为在线模仿学习,每实例从零训练。
  • 在Taillard PFSP上平均比GPU-GRASP优28.4个完工时间单位。
  • 无需预训练数据或手工特征,适合难解问题的自适应求解。

传统组合优化的机器学习方法依赖于大规模离线数据集上的强化学习训练,成本高且泛化能力差。本文提出一种新框架:将GRASP的随机构造阶段重构为在线模仿学习任务,针对每个问题实例从零训练。局部搜索作为专家策略,解码器仅的Transformer作为构造策略。与经典GRASP依赖静态、局部启发式规则不同,该方法完全数据驱动,构造策略由搜索过程中发现的高质量解演化而来,无需问题特定特征工程。我们实现为LM-GRASP,一种迭代学习-推理-改进的混合元启发式算法,通过行为克隆在动态精英轨迹存档上在线训练策略,无需外部数据或离线预训练。该流程仅通过局部搜索使用的目标评估器与领域交互。在最具挑战性的Taillard PFSP基准(ta51-ta60)上,LM-GRASP平均比GPU-GRASP优28.4个完工时间单位,接近于GPU加速带来的收益(27.2单位),尽管标准差有重叠。这表明实例级、在线训练的语言模型是手工程构器的有前景且实用的替代方案,尤其适用于经典贪心构造难以处理的问题空间。

原文摘要 · Abstract (English)

Machine learning for combinatorial optimization typically relies on neural constructors trained via reinforcement learning on large offline datasets for a fixed problem class-incurring high pretraining costs and generalizing poorly outside the training distribution. We propose an alternative: a metaheuristic framework that reformulates the randomized constructive phase of GRASP as an online imitation learning task, trained from scratch on each problem instance. A local search procedure acts as an expert oracle, while a decoder-only Transformer serves as the constructive policy. Unlike classical GRASP, which relies on static, myopic heuristic rules based on localized scalar costs, our approach is fully data-driven: the construction policy emerges from high-quality solutions discovered during the search itself, with no problem-specific feature engineering required. We instantiate this as LM-GRASP, a hybrid metaheuristic following an iterative learn-infer-improve cycle, training the policy online via behavioral cloning on a dynamic archive of elite trajectories-no external data or offline pretraining needed. The pipeline interfaces with the domain solely through the objective evaluator used by local search. Evaluated on the Taillard PFSP benchmark (ta51-ta60), the most discriminating block due to half its optima being unknown, LM-GRASP outperforms GPU-GRASP by 28.4 makespan units on average-comparable to the gain from GPU acceleration over sequential execution (27.2 units), though with overlapping standard deviations. This suggests instance-specific, online-trained language models are a promising, practical alternative to hand-engineered constructors, especially for landscapes resistant to classical greedy construction.

组合优化模仿学习在线训练元启发式

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。