arXiv:2507.11737cs.AI2025-07被引 12

用大模型自动解动态规划题,效果超主流模型。

Auto-Formulating Dynamic Programming Problems with Large Language Models

  • 专设模型DPLM+双通道数据生成,提升建模能力
  • 在难问题上超越o1和DeepSeek-R1,70%正确率
  • 适合算法研究者与自动化建模需求者

动态规划(DP)是运筹学中的基础方法,但传统建模需深厚领域与技术知识。大语言模型(LLM)有望实现自动化,但因状态转移的随机性及训练数据稀缺,难以直接套用现有优化类模型。为此,我们提出首个覆盖多种教科书级DP问题的基准测试集DP-Bench,用于系统评估。设计70亿参数的专用模型DPLM,其性能可媲美OpenAI o1和DeepSeek-R1,在复杂问题上更胜一筹。核心在于创新的DualReflect合成数据生成流程:正向生成增强多样性,反向生成保障正确性。实验表明,在数据有限时反向生成更优;而数据规模扩大后,正向生成的多样性优势凸显。两者互补,共同提升模型表现。

原文摘要 · Abstract (English)

Dynamic programming (DP) is a fundamental method in operations research, but formulating DP models has traditionally required expert knowledge of both the problem context and DP techniques. Large Language Models (LLMs) offer the potential to automate this process. However, DP problems pose unique challenges due to their inherently stochastic transitions and the limited availability of training data. These factors make it difficult to directly apply existing LLM-based models or frameworks developed for other optimization problems, such as linear or integer programming. We introduce DP-Bench, the first benchmark covering a wide range of textbook-level DP problems to enable systematic evaluation. We present Dynamic Programming Language Model (DPLM), a 7B-parameter specialized model that achieves performance comparable to state-of-the-art LLMs like OpenAI's o1 and DeepSeek-R1, and surpasses them on hard problems. Central to DPLM's effectiveness is DualReflect, our novel synthetic data generation pipeline, designed to scale up training data from a limited set of initial examples. DualReflect combines forward generation for diversity and backward generation for reliability. Our results reveal a key insight: backward generation is favored in low-data regimes for its strong correctness guarantees, while forward generation, though lacking such guarantees, becomes increasingly valuable at scale for introducing diverse formulations. This trade-off highlights the complementary strengths of both approaches and the importance of combining them.

动态规划大模型自动建模数据生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。