arXiv:2608.25220cs.AIcs.LO2026-08被引 1

用大模型和形式化证明验证优化模型的改写是否正确

FLARE: Verifying MILP Reformulations with LLM-Based Theorem Proving

  • 用大模型+形式化系统在Lean中构造可机器验证的模型改写标准
  • 在20个难题上100%准确验证,且给出可检查的证明证书
  • 适合需要高可靠性的自动化建模场景,如工业优化

混合整数线性规划(MILP)是组合优化的核心工具,广泛应用于实际问题。高效建模的关键在于设计计算高效的公式。大语言模型(LLMs)为自动建模提供了新可能,包括推导和强化公式。但自动化需可靠的验证方法来确保改写后的公式仍保留原问题特性。现有方法仅数值评估,无法处理一般情况。本文提出一种可构造的形式化定义,可在Lean中形式化并机器验证。我们开发了FLARE(Formulation-Level Automated Reformulation Evaluation),通过大模型代理与Lean证明器验证提议公式与参考公式的等价性。为评估,构建了FormulationBench数据集,包含20个问题和109种公式。FLARE在该数据集的NP-hard子集上达到100%准确率,并为每个被接受的改写生成机器可查证的证书。对于无需形式保证的场景,提出FLARE-NL,快速低成本但精度相当,不生成证书。这些方法实现了自动化优化建模中的可靠验证。

原文摘要 · Abstract (English)

Mixed-Integer Linear Programming (MILP) is a fundamental tool for combinatorial optimization with extensive real-world applications. A central challenge is designing computationally efficient MILP formulations. Large Language Models (LLMs) offer new opportunities to automate the modeling process, from deriving formulations to strengthening them. Reliable automation requires robust methods for verifying that proposed formulations preserve the underlying optimization problem. However, existing approaches evaluate formulations numerically and fail to reason about general problem instances. We resolve this limitation by introducing a constructive definition of MILP reformulation that can be formalized in Lean and machine-checked. We develop FLARE (Formulation-Level Automated Reformulation Evaluation), a method that uses an LLM-based agent and the Lean proof assistant to verify proposed reformulations against a reference formulation. To evaluate our approach, we introduce FormulationBench, a challenging dataset of 20 problems and 109 formulations. FLARE outperforms existing methods, with 100% accuracy on the NP-hard subset of FormulationBench. Furthermore, FLARE produces a machine-checkable certificate for every reformulation it accepts. For cases where formal guarantees are not necessary, we introduce FLARE-NL, a fast and cheap LLM proxy that matches FLARE's accuracy but produces no certificate. These methods enable reliable verification in automated optimization modeling.

优化建模大模型形式化验证MILP

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。