arXiv:2605.23966cs.CLcs.AI2026-05被引 1

通过三阶段验证提升优化建模准确性,显著改善复杂问题建模效果。

TriVAL: A Tri-Validation Framework for Faithful Automatic Optimization Modeling

论文配图:TriVAL: A Tri-Validation Framework for Faithful Automatic Optimization Modeling
图 1 · 摘自论文原文
  • 分三阶段(语义、公式、代码)循环验证,及时发现并修正错误。
  • 在150个复杂组合问题上,对最困难问题的准确率提升显著。
  • 适合需要高可靠性的工业优化建模场景,如供应链、调度系统。

优化建模是自然语言问题描述与优化求解器之间的关键桥梁,也是将运筹学应用于现实决策的核心。近期大语言模型的发展推动了自动优化建模的进步,但现有方法在建模过程中缺乏显式验证,导致早期错误在流程中累积,降低最终建模精度。为此,我们提出TriVAL,一个三阶段验证框架,分别在语义规范、数学公式和代码生成阶段执行显式验证。每个阶段均采用构建-验证-修正的循环,依据阶段特异性标准评估结果并必要时修正。该设计可防止错误积累,保持建模全过程的忠实性。为进一步评估自动优化建模在更具挑战性的组合问题上的表现,我们引入NL4COP,一个包含150个实例、覆盖50种多样化问题类型的基准,其决策逻辑更复杂、约束耦合更紧密、建模要求更高。在NL4COP及现有基准上的实验表明,TriVAL持续优于当前最优方法,尤其在最难问题上提升最为明显。

原文摘要 · Abstract (English)

Optimization modeling serves as the pivotal bridge between natural-language problem descriptions and optimization solvers, and remains a cornerstone for bringing operations research (OR) into real-world decision making. Recent advances in large language models (LLMs) have driven significant progress in automatic optimization modeling. However, existing methods still lack explicit validation during the modeling process, allowing errors introduced in earlier stages to carry through the pipeline and ultimately reduce final modeling accuracy. To address this challenge, we introduce TriVAL, a tri-validation framework that performs explicit validation at three stages of automatic optimization modeling: semantic specification, mathematical formulation, and code generation. At each stage, TriVAL follows a construct-validate-revise loop that assesses the current result against stage-specific criteria and revises it when needed. This design helps identify and correct errors before they accumulate across stages, helping preserve faithfulness throughout the modeling process. To evaluate automatic optimization modeling on more challenging combinatorial problems, we further introduce NL4COP, a benchmark of 150 instances across 50 diverse problem types with more complex decision logic, more tightly coupled constraints, and more demanding modeling requirements than existing benchmarks. Experiments on NL4COP and established benchmarks show that TriVAL consistently outperforms state-ofthe-art methods, with the largest gains on the most challenging problems.

优化建模大模型验证框架运筹学

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。