arXiv:2508.03117cs.AI2025-08被引 6

用可验证的合成数据训练可信优化建模大模型

Toward a Trustworthy Optimization Modeling Agent via Verifiable Synthetic Data Generation

  • 构建可验证的合成数据流水线,生成带已知最优解的优化问题实例
  • 在7个数据集上6个达最佳性能,3个领先超8个百分点
  • 适合需要高可靠性优化建模的工业应用与研究者

我们提出一个框架,通过可验证的合成数据生成管道,训练可信的大语言模型(LLM)优化建模代理。聚焦线性与混合整数线性规划,该方法从结构化符号表示出发,系统生成自然语言描述、数学公式和可执行代码。通过程序化构建每项实例并附带已知最优解,确保全程可验证,并自动过滤教师模型生成的低质量示范。每个数据实例包含优化问题的结构化表示、对应自然语言描述、验证过的最优解及多语言建模求解步骤演示。这支持对开源LLM进行监督微调,专精于优化任务。为落地该流水线,我们引入OptiTrust,一个模块化LLM代理,实现从自然语言到求解器就绪代码的多阶段转换,利用逐步演示、多语言推理与多数投票交叉验证。该代理在标准基准上达到最先进水平:7个数据集中有6个表现最优,其中3个较次优算法提升至少8个百分点。本方法为构建真实世界优化应用中可靠的LLM代理提供了可扩展、可验证且原理清晰的路径。

原文摘要 · Abstract (English)

We present a framework for training trustworthy large language model (LLM) agents for optimization modeling via a verifiable synthetic data generation pipeline. Focusing on linear and mixed-integer linear programming, our approach begins with structured symbolic representations and systematically produces natural language descriptions, mathematical formulations, and solver-executable code. By programmatically constructing each instance with known optimal solutions, the pipeline ensures full verifiability and enables automatic filtering of low-quality demonstrations generated by teacher models. Each dataset instance includes a structured representation of the optimization problem, a corresponding natural language description, the verified optimal solution, and step-by-step demonstrations - generated by a teacher model - that show how to model and solve the problem across multiple optimization modeling languages. This enables supervised fine-tuning of open-source LLMs specifically tailored to optimization tasks. To operationalize this pipeline, we introduce OptiTrust, a modular LLM agent that performs multi-stage translation from natural language to solver-ready code, leveraging stepwise demonstrations, multi-language inference, and majority-vote cross-validation. Our agent achieves state-of-the-art performance on standard benchmarks. Out of 7 datasets, it achieves the highest accuracy on six and outperforms the next-best algorithm by at least 8 percentage on three of them. Our approach provides a scalable, verifiable, and principled path toward building reliable LLM agents for real-world optimization applications.

优化建模可验证数据LLM代理合成数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。