arXiv:2510.21436cs.AI2025-10NeurIPS被引 2

让机器自动读图解优化题,从手写公式到求解一气呵成。

AutoOpt: A Dataset and a Unified Framework for Automating Optimization Problem Solving

  • 用深度学习把优化问题图像转成可计算的LaTeX代码
  • 在11000+样本上训练,识别准确率超ChatGPT等大模型
  • 端到端框架支持复杂非线性/多目标问题求解,适合科研与工程应用

本研究提出AutoOpt-11k数据集,包含超过11,000张手写与印刷体数学优化问题图像,涵盖单目标、多目标、多层及随机优化问题,具有非线性、非凸性、不可导性、间断性及高维等复杂特性。所有图像配有LaTeX标注,部分还提供建模语言表示。数据由25位专家按伦理准则创建,并经两阶段验证确保质量。同时构建AutoOpt框架,实现优化问题自动化求解:模块M1(Image_to_Text)通过深度学习模型完成数学表达式识别(MER),生成对应LaTeX;模块M2(Text_to_Text)使用微调的小型LLM将LaTeX转换为PYOMO脚本;模块M3(Optimization)采用基于双层优化分解(BOBD)的方法求解。该框架以AutoOpt-11k进行训练与测试,其中MER模型在BLEU评分上优于ChatGPT、Gemini和Nougat;BOBD方法在复杂测试问题上表现优于内点法和遗传算法。

原文摘要 · Abstract (English)

This study presents AutoOpt-11k, a unique image dataset of over 11,000 handwritten and printed mathematical optimization models corresponding to single-objective, multi-objective, multi-level, and stochastic optimization problems exhibiting various types of complexities such as non-linearity, non-convexity, non-differentiability, discontinuity, and high-dimensionality. The labels consist of the LaTeX representation for all the images and modeling language representation for a subset of images. The dataset is created by 25 experts following ethical data creation guidelines and verified in two-phases to avoid errors. Further, we develop AutoOpt framework, a machine learning based automated approach for solving optimization problems, where the user just needs to provide an image of the formulation and AutoOpt solves it efficiently without any further human intervention. AutoOpt framework consists of three Modules: (i) M1 (Image_to_Text)- a deep learning model performs the Mathematical Expression Recognition (MER) task to generate the LaTeX code corresponding to the optimization formulation in image; (ii) M2 (Text_to_Text)- a small-scale fine-tuned LLM generates the PYOMO script (optimization modeling language) from LaTeX code; (iii) M3 (Optimization)- a Bilevel Optimization based Decomposition (BOBD) method solves the optimization formulation described in the PYOMO script. We use AutoOpt-11k dataset for training and testing of deep learning models employed in AutoOpt. The deep learning model for MER task (M1) outperforms ChatGPT, Gemini and Nougat on BLEU score metric. BOBD method (M3), which is a hybrid approach, yields better results on complex test problems compared to common approaches, like interior-point algorithm and genetic algorithm.

优化求解图像识别自动化建模AI for Science

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。