arXiv:2509.12643cs.AI2025-09ACL

让大模型主动设计优化策略,解决复杂约束问题。

Learn to Relax with Large Language Models: Solving Constraint Optimization Problems via Bidirectional Coevolution

  • 用统一表示法让大模型同时生成、解释和执行松弛策略。
  • 结合蒙特卡洛树搜索与进化算法,实现全局探索与局部优化协同。
  • 在困难场景下表现优于现有方法,适合需要可验证推理的优化任务。

基于大语言模型(LLM)的优化在自主求解中展现出潜力,但多数方法仍将LLM视为被动的约束检查器,而非主动的策略设计者,限制了其在复杂约束优化问题(COPs)上的效果。为此,我们提出AutoCO——一种端到端的自动化约束优化方法,将运筹学中的约束松弛原则与LLM推理紧密结合。核心创新在于统一的三重表示:松弛策略、算法原理与可执行代码。该设计使LLM能够合成、论证并实例化既符合原则又可运行的松弛策略。为应对碎片化解空间,AutoCO采用双向全局-局部共进化机制,协同使用蒙特卡洛树搜索(MCTS)进行全局松弛轨迹探索,以及进化算法(EAs)进行局部解强化。两者持续交换先验与反馈,明确平衡多样性与集中性,防止过早收敛。在三个具有挑战性的COP基准测试上,实验验证了AutoCO的一致有效性与优越性能,尤其在当前方法退化的困难情形下表现突出。结果表明,AutoCO是迈向主动、可验证的LLM驱动优化的一条原则性路径。

原文摘要 · Abstract (English)

Large Language Model (LLM)-based optimization has recently shown promise for autonomous problem solving, yet most approaches still cast LLMs as passive constraint checkers rather than proactive strategy designers, limiting their effectiveness on complex Constraint Optimization Problems (COPs). To address this, we present AutoCO, an end-to-end Automated Constraint Optimization method that tightly couples operations-research principles of constraint relaxation with LLM reasoning. A core innovation is a unified triple-representation that binds relaxation strategies, algorithmic principles, and executable codes. This design enables the LLM to synthesize, justify, and instantiate relaxation strategies that are both principled and executable. To navigate fragmented solution spaces, AutoCO employs a bidirectional global-local coevolution mechanism, synergistically coupling Monte Carlo Tree Search (MCTS) for global relaxation-trajectory exploration with Evolutionary Algorithms (EAs) for local solution intensification. This continuous exchange of priors and feedback explicitly balances diversification and intensification, thus preventing premature convergence. Extensive experiments on three challenging COP benchmarks validate AutoCO's consistent effectiveness and superior performance, especially in hard regimes where current methods degrade. Results highlight AutoCO as a principled and effective path toward proactive, verifiable LLM-driven optimization.

约束优化大模型推理自动求解共进化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。