arXiv:2606.04816cs.AIcs.LG2026-06被引 1

用约束探测提升大模型求解车辆路径问题的准确性

Beyond Objective Equivalence: Constraint Injection for LLM-Based Optimization Modeling on Vehicle Routing Problems

论文配图:Beyond Objective Equivalence: Constraint Injection for LLM-Based Optimization Modeling on Vehicle Routing Problems
图 1 · 摘自论文原文
  • 设计约束探测机制,识别模型生成代码中的多余或遗漏约束
  • 在4个车辆路径问题基准上实现93%的通过率,显著优于现有模型
  • 适合关注优化建模可靠性与大模型自动编码的研究者

大型语言模型(LLM)正越来越多地将自然语言描述的优化问题转化为可执行求解器代码。然而,对于约束密集型运筹学(OR)问题,现有数据筛选与训练流程主要依赖目标等价信号,如差异测试和答案一致,这可能导致程序在测试实例中通过,却添加冗余约束或悄悄遗漏必要约束,尤其当这些约束在特定实例中非紧致时。本文提出约束注入方法,利用可行探针暴露冗余约束,使用违反一个约束的探针揭示隐性遗漏。结合差异测试,形成双重验证机制。我们在车辆路径问题(VRP)这一典型约束密集的组合优化基准上进行实例化与评估,构建了80亿参数的端到端模型VRPCoder,可将自然语言的VRP场景转化为Gurobi脚本,并开发了一个由专家验证的包含21种变体的VRP基准套件。该验证器被用作数据合成中的拒绝采样过滤器,以及群体相对策略优化(GRPO)中的每轮奖励。在四个VRP基准上,VRPCoder-GRPO达到93%平均Pass@1,优于Gemini-3.1-Pro Preview三个基准,较Claude-Sonnet-4.5高出28分,比先前的OR-LLMs高出78分。

原文摘要 · Abstract (English)

Large language models (LLMs) increasingly translate natural-language optimization problems into executable solver code. Yet for constraint-dense operations research (OR) problems, existing data-filtering and training pipelines largely rely on objective-equivalence signals such as differential testing and answer agreement, which a program can pass while adding spurious constraints or silently omitting required ones, whenever those constraints are non-binding on the tested instance. We propose constraint injection, which uses feasible probes to expose spurious over-constraint and one-constraint-violating probes to reveal silent constraint omission. Combined with differential testing, it forms a dual verifier. We instantiate and evaluate it on vehicle routing problems (VRPs), a representative constraint-dense combinatorial optimization testbed with coupled operational constraints. We develop VRPCoder, an 8B end-to-end model that translates natural-language VRP scenarios into Gurobi scripts, together with an expert-verified VRP benchmark suite covering 21 variants. The verifier is reused as a rejection-sampling filter during data synthesis and as a per-rollout reward in group relative policy optimization (GRPO). Across four VRP benchmarks, VRPCoder-GRPO reaches 93\% average Pass@1, outperforms Gemini-3.1-Pro Preview on three benchmarks, exceeds Claude-Sonnet-4.5 by 28 average points, and surpasses prior OR-LLMs by 78 average points.

大模型优化车辆路径约束验证

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。