让模型自动生成优化问题,通过弱点反哺数据,持续进化。
EvoOptiGraph: Weakness-Driven Coevolution via Graph-Based Structural Generation for Optimization Modeling

- 用图结构表示优化问题,通过演化生成多样实例。
- 在6个数据集上超越更大模型和专用方法,准确率与可执行性双提升。
- 适合想提升大模型求解优化问题能力的研究者与工程师。
利用大语言模型(LLM)自动从自然语言生成优化模型面临两大挑战:训练语料缺乏结构多样性,且数据生成流程与模型学习脱节。为此,我们提出EvoOptiGraph框架,实现数据与模型的协同进化,以模型弱点为驱动力。该框架将每个混合整数线性规划(MILP)表示为带属性的二分图,并应用保持有效性的演化算子生成结构多样的实例。演化后的图通过确定性编译转换为求解器代码和自然语言,并经回译验证。训练分为两阶段:先在初始数据集上进行监督微调(SFT),再通过可验证奖励的强化学习(RLVR),以图衍生的弱点信号指导新实例生成,聚焦模型失败点。形成闭环持续更新训练分布。六组公开数据集上的实验表明,EvoOptiGraph显著优于更大规模通用模型、代理式方法及专用基线,在准确率、可执行性和泛化能力上均有提升。结果证明,针对性的数据-模型共进化是提升LLM在优化建模任务表现的有效策略。
原文摘要 · Abstract (English)
Automating optimization modeling from natural language with large language models (LLMs) faces two key challenges. First, training corpora lack structural diversity. Second, data generation pipelines remain static and decoupled from model learning. To address these challenges, we propose EvoOptiGraph, a novel framework where data and model co-evolve, driven by model weaknesses. EvoOptiGraph represents each mixed-integer linear program (MILP) as an attributed bipartite graph and applies validity-preserving evolutionary operators to generate structurally diverse instances. The evolved graphs are converted into solver code and natural language via deterministic compilation and verified back-translation. Training proceeds in two stages: supervised fine-tuning (SFT) on an initial dataset, followed by reinforcement learning with verifiable rewards (RLVR), where graph-derived weakness signals guide the generation of new instances targeting the model's failures. This forms a closed loop that continuously updates the training distribution. Empirical results on six public datasets show that EvoOptiGraph significantly outperforms larger generalist models, agentic methods, and specialized baselines in accuracy, executability, and generalization. These results demonstrate that targeted data-model coevolution is an effective strategy for improving LLMs on optimization modeling tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。