arXiv:2506.15196cs.AI2025-06被引 21

用大模型自动设计并选择优化策略,解决复杂组合优化问题

HeurAgenix: Leveraging LLMs for Solving Complex Combinatorial Optimization Challenges

  • 分两阶段:先用大模型提炼进化策略,再动态选最优解法
  • 在经典基准上超越现有方法,媲美专业求解器性能
  • 支持轻量模型部署,适合需要高效推理的工业场景

启发式算法在求解组合优化(CO)问题中至关重要,但传统设计高度依赖人工经验,难以跨实例泛化。我们提出 extbf{HeurAgenix},一种基于大语言模型(LLM)的两阶段超启发式框架:第一阶段利用LLM比较种子解与高质量解,提取可复用的进化策略;第二阶段在求解过程中,基于LLM的感知能力动态选择最适配当前状态的启发式策略。为提升灵活性,该选择器可采用前沿大模型或经微调的轻量模型以降低推理成本。针对CO问题监督信号稀缺的问题,我们引入双奖励机制,联合利用选择偏好与状态感知信号,实现噪声标注下的鲁棒选择。在典型基准上的大量实验表明,HeurAgenix不仅优于现有基于LLM的超启发式方法,还达到甚至超过专用求解器水平。代码已公开于https://github.com/microsoft/HeurAgenix。

原文摘要 · Abstract (English)

Heuristic algorithms play a vital role in solving combinatorial optimization (CO) problems, yet traditional designs depend heavily on manual expertise and struggle to generalize across diverse instances. We introduce \textbf{HeurAgenix}, a two-stage hyper-heuristic framework powered by large language models (LLMs) that first evolves heuristics and then selects among them automatically. In the heuristic evolution phase, HeurAgenix leverages an LLM to compare seed heuristic solutions with higher-quality solutions and extract reusable evolution strategies. During problem solving, it dynamically picks the most promising heuristic for each problem state, guided by the LLM's perception ability. For flexibility, this selector can be either a state-of-the-art LLM or a fine-tuned lightweight model with lower inference cost. To mitigate the scarcity of reliable supervision caused by CO complexity, we fine-tune the lightweight heuristic selector with a dual-reward mechanism that jointly exploits singals from selection preferences and state perception, enabling robust selection under noisy annotations. Extensive experiments on canonical benchmarks show that HeurAgenix not only outperforms existing LLM-based hyper-heuristics but also matches or exceeds specialized solvers. Code is available at https://github.com/microsoft/HeurAgenix.

组合优化大模型超启发式智能求解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。