arXiv:2507.20923cs.NEcs.AI2025-07AAAI被引 9

用网格引导的LLM快速生成多样高效的多目标优化启发式方法

Pareto-Grid-Guided Large Language Models for Fast and High-Quality Heuristics Design in Multi-Objective Combinatorial Optimization

  • 基于帕累托网格划分目标空间,引导LLM生成逻辑不同的启发式
  • 在多个测试实例上比现有方法快3倍以上,性能接近传统进化算法
  • 适合需要快速生成高质量多目标解的工业优化场景

多目标组合优化问题(MOCOP)在实际应用中频繁出现,需同时优化相互冲突的目标。传统进化算法虽有效,但依赖领域知识和反复调参,难以适应未见实例。近年来,将大语言模型(LLMs)引入进化计算,利用其语言理解和代码生成能力实现启发式自动构造。然而,多数现有方法集中于单目标任务,忽视多目标设置下的运行效率与启发式多样性。为此,我们提出基于帕累托前沿网格引导的LLM进化框架MPaGE,对简单多目标进化优化(SEMO)进行增强。通过将目标空间划分为网格,保留高性能候选者以指导启发式生成,MPaGE利用LLM在变异阶段优先选择语义结构差异大的启发式,从而提升种群多样性并减少冗余。大量实验表明,MPaGE在性能上优于现有基于LLM的框架,在多个数据集上达到与传统多目标进化算法(MOEAs)相当的结果,且运行时间显著更短。

原文摘要 · Abstract (English)

Multi-objective combinatorial optimization problems (MOCOP) frequently arise in practical applications that require the simultaneous optimization of conflicting objectives. Although traditional evolutionary algorithms can be effective, they typically depend on domain knowledge and repeated parameter tuning, limiting flexibility when applied to unseen MOCOP instances. Recently, integration of Large Language Models (LLMs) into evolutionary computation has opened new avenues for automatic heuristic generation, using their advanced language understanding and code synthesis capabilities. Nevertheless, most existing approaches predominantly focus on single-objective tasks, often neglecting key considerations such as runtime efficiency and heuristic diversity in multi-objective settings. To bridge this gap, we introduce Multi-heuristics for MOCOP via Pareto-Grid-guided Evolution of LLMs (MPaGE), a novel enhancement of the Simple Evolutionary Multiobjective Optimization (SEMO) framework that leverages LLMs and Pareto Front Grid (PFG) technique. By partitioning the objective space into grids and retaining top-performing candidates to guide heuristic generation, MPaGE utilizes LLMs to prioritize heuristics with semantically distinct logical structures during variation, thus promoting diversity and mitigating redundancy within the population. Through extensive evaluations, MPaGE demonstrates superior performance over existing LLM-based frameworks, and achieves competitive results to traditional Multi-objective evolutionary algorithms (MOEAs), with significantly faster runtime. Our code is available at: https://github.com/langkhachhoha/MPaGE.

多目标优化LLM生成启发式设计进化计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。