用双侧验证提升大模型优化建模准确率
Opt-Verifier: Unleashing the Power of LLMs for Optimization Modeling via Dual-Side Verification

- 从结构与解两方面验证生成的优化模型
- 在基准测试上准确率提升超20%
- 适合需要高可靠建模的工业应用
构建数学优化模型在运筹学中至关重要,但需大量人工专业知识。近期研究利用大语言模型(LLMs)自动化建模过程,但现有方法难以验证生成模型的正确性,缺乏对约束、变量合理性及解有效性的检查,阻碍后续验证与修正,严重影响建模准确率。为此,我们提出基于双侧验证(Opt-Verifier)的LLM框架,从结构与解两个角度提升准确性。结构侧验证确保生成模型的结构与原始问题描述一致,准确捕捉约束与要求;解侧验证则解释并评估解的有效性,确认模型在逻辑与数学上成立。在多个主流基准上的实验表明,该方法准确率提升超过20%。
原文摘要 · Abstract (English)
Building mathematical optimization models is critical in operations research (OR), while it requires substantial human expertise. Recent advancements have utilized large language models (LLMs) to automate this modeling process. However, existing works often struggle to verify the correctness of the generated optimization models, without checking the rationality of the constraints and variables or the validity of solutions to the generated models. This hampers the subsequent verification and correction steps, and thus it severely hurts the modeling accuracy. To address this challenge, we propose a novel LLM-based framework with Dual-side Verification (Opt-Verifier) from both structure and solution perspectives, thereby improving the modeling accuracy. The structure-side verification ensures that the modeling structure of the generated optimization models aligns with the original problem description, accurately capturing the problem's constraints and requirements. Meanwhile, the solution-side verification interprets and evaluates the solutions' validity, confirming that the optimization models are logically and mathematically sound. Experiments on popular benchmarks demonstrate that our approach achieves over 20\% improvement in accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。