arXiv:2502.11102cs.AIcs.LG2025-02ICML被引 52

构建可扩展的优化建模数据集,提升大模型从自然语言生成数学模型的能力。

OptMATH: A Scalable Bidirectional Data Synthesis Framework for Optimization Modeling

  • 基于数学公式生成可控复杂度问题,再通过反向翻译得到自然语言
  • 训练模型在多个基准上表现优于现有方法,0.5B到32B参数均有效
  • 提供长文本难题集,适合研究模型泛化与复杂问题求解

尽管大型语言模型迅速发展,但高质量优化建模数据集的缺失仍制约着其从自然语言描述中稳健构建实际优化问题的能力,也导致基于学习的方法泛化困难。为此,我们提出一个可扩展的数据合成框架OptMATH。该框架从经筛选的数学公式种子数据出发,自动生成具有可控复杂度的问题数据(PD),再通过反向翻译获取自然语言(NL)。为验证NL与PD的一致性,采用正向建模并结合拒绝采样筛选,通过的样本构成训练集。被拒样本进一步筛选后形成新基准,包含长度远超NL4OPT和MAMO的难题。大量实验表明,使用OptMATH训练的0.5B至32B参数模型在多个建模基准上均取得更优结果,验证了方法的有效性与可扩展性。数据集已开源:https://github.com/AuroraLHL/OptMATH。

原文摘要 · Abstract (English)

Despite the rapid development of large language models (LLMs), a fundamental challenge persists: the lack of high-quality optimization modeling datasets hampers LLMs' robust modeling of practical optimization problems from natural language descriptions (NL). This data scarcity also contributes to the generalization difficulties experienced by learning-based methods. To address these challenges, we propose a scalable framework for synthesizing a high-quality dataset, named OptMATH. Starting from curated seed data with mathematical formulations (MF), this framework automatically generates problem data (PD) with controllable complexity. Then, a back-translation step is employed to obtain NL. To verify the correspondence between the NL and the PD, a forward modeling step followed by rejection sampling is used. The accepted pairs constitute the training part of OptMATH. Then a collection of rejected pairs is identified and further filtered. This collection serves as a new benchmark for optimization modeling, containing difficult instances whose lengths are much longer than these of NL4OPT and MAMO. Through extensive experiments, we demonstrate that models of various sizes (0.5B-32B parameters) trained on OptMATH achieve superior results on multiple modeling benchmarks, thereby validating the effectiveness and scalability of our approach. Our dataset is publicly available at https://github.com/AuroraLHL/OptMATH.

优化建模数据合成大模型自然语言

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。