用大模型自动构建工业优化模型,降低人工依赖。
EvoOpt-LLM: Evolving industrial optimization models with large language models
- 基于7B参数大模型,通过高效微调实现模型自动生成
- 生成成功率91%,可执行率65.9%,仅需3000样本训练
- 支持动态规则注入与变量剪枝,适合工业场景快速迭代
混合整数线性规划(MILP)是工业规划与调度的核心,但将自然语言需求转化为可求解模型并随业务规则演变维护,仍高度依赖专家。现有大模型方法普遍存在数据效率低、求解器级有效性不足、难以扩展至工业规模的问题。为此,我们提出EvoOpt-LLM,一个支持工业优化建模全生命周期的统一框架,涵盖自动化模型构建、动态业务约束注入及端到端变量剪枝。基于7B参数大模型,采用参数高效的LoRA微调,仅需3000个训练样本即达91%生成率与65.9%可执行率,关键性能在1500样本时显著提升。约束注入模块能可靠扩充原有MILP模型且不破坏原目标函数,变量剪枝模块在中等规模线性规划模型上实现约0.56的F1得分,仅需400样本。EvoOpt-LLM展示了一种实用、数据高效的工业优化建模方案,减少对专家干预的需求,提升适应性与求解效率。
原文摘要 · Abstract (English)
Optimization modeling via mixed-integer linear programming (MILP) is fundamental to industrial planning and scheduling, yet translating natural-language requirements into solver-executable models and maintaining them under evolving business rules remains highly expertise-intensive. While large language models (LLMs) offer promising avenues for automation, existing methods often suffer from low data efficiency, limited solver-level validity, and poor scalability to industrial-scale problems. To address these challenges, we present EvoOpt-LLM, a unified LLM-based framework supporting the full lifecycle of industrial optimization modeling, including automated model construction, dynamic business-constraint injection, and end-to-end variable pruning. Built on a 7B-parameter LLM and adapted via parameter-efficient LoRA fine-tuning, EvoOpt-LLM achieves a generation rate of 91% and an executability rate of 65.9% with only 3,000 training samples, with critical performance gains emerging under 1,500 samples. The constraint injection module reliably augments existing MILP models while preserving original objectives, and the variable pruning module enhances computational efficiency, achieving an F1 score of ~0.56 on medium-sized LP models with only 400 samples. EvoOpt-LLM demonstrates a practical, data-efficient approach to industrial optimization modeling, reducing reliance on expert intervention while improving adaptability and solver efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。