arXiv:2605.29829cs.AIcs.LG2026-05被引 2

通过问题原型聚类,让AI学会可复用的优化求解技能。

OptSkills: Learning Generalizable Optimization Skills from Problem Archetypes via Cluster-Based Distillation

论文配图:OptSkills: Learning Generalizable Optimization Skills from Problem Archetypes via Cluster-Based Distillation
图 1 · 摘自论文原文
  • 按问题本质原型聚类,而非表面描述,提升泛化能力。
  • 在每类原型中探索多种建模与求解方式,提炼出可复用的工作流技能。
  • 新问题可更新技能库,适合需要快速适应新场景的优化任务。

利用大语言模型从自然语言自动构建并求解优化问题,已成为自动化优化的有效范式。然而现有方法泛化能力有限:对表面叙述变化敏感,经验仅停留在具体案例层面,难以适应新或变化的问题类型。我们提出 OptSkills,一种以问题原型为中心的技能学习与推理系统,用于优化建模与求解。为提升鲁棒泛化性,系统基于问题本质原型而非表面叙事进行聚类;为提升分布内泛化性,在每个原型簇内探索多样建模范式与求解配置,并将成功轨迹提炼为可复用的工作流级技能;为提升分布外泛化性,通过新获取轨迹优化已有技能或扩充技能库。系统在涵盖多种问题类型与场景的数据集上达到68.27%的微平均准确率;在高难度大规模高维基准MIPLIB-NL上达到26.91%准确率,优于DeepSeek-V3.2-Thinking 4.53%。在Nano-CO上完成技能学习后,于OOD NLCO基准达到72.79%准确率。代码与技能资源已开源。

原文摘要 · Abstract (English)

Leveraging Large Language Models (LLMs) to automatically formulate and solve optimization problems from natural language has emerged as an efficient paradigm for automated optimization. However, existing methods still exhibit limited generalization: they are sensitive to superficial narrative variations, reuse experience mainly at the case level, and struggle to adapt to shifted or emerging problem types. We propose OptSkills, an archetype-centric skill learning and reasoning agent system for optimization modeling and solving. To improve robust generalization, our system clusters problems by their underlying archetypes rather than surface narratives. To improve in-distribution generalization, it explores diverse modeling paradigms and solver configurations within each cluster, then distills successful trajectories into reusable workflow-level skills. To improve out-of-distribution generalization, it refines existing skills or expands the skill library using newly obtained trajectories. Our system achieves a state-of-the-art micro-averaged accuracy of 68.27% on datasets encompassing diverse problem types and scenarios. In addition, on MIPLIB-NL, a highly challenging large-scale and high-dimensional benchmark, it achieves 26.91% accuracy, outperforming DeepSeek-V3.2-Thinking by 4.53%. After skill learning on Nano-CO, it reaches 72.79% on the OOD NLCO benchmark. Code and skills are available at https://github.com/fujiwaranoM0kou/OptSkills.

优化建模技能学习大模型应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。