用大模型协同进化多个启发式组件,提升组合优化性能。
MuEvo: LLM-Driven Evolution of Multi-Heuristic Ensemble

- 通过动态管理组件生命周期和多组评估实现组件协同演化。
- 在4个优化领域中优于人工设计框架及现有方法。
- 适合需要多组件协同优化的研究者与工程应用。
基于大语言模型的自动化启发式设计(LLM-AHD)在发现组合优化问题的有效启发式方面展现出强大潜力。然而,现有方法主要优化单一启发式,而实际优化框架通常依赖多个相互作用的组件。直接扩展单启发式方法存在挑战:早期组件选择可能忽略后期有潜力的组件,而独立演化则忽视组件间的依赖关系。我们提出MuEvo,一种基于大模型的集成启发式演化框架,采用集成级反馈机制。MuEvo结合动态组件管理(通过短预算探测和可逆生命周期动态调整组件优先级)与大模型驱动的协同演化,通过多集成评估、跨组件信息共享、关系引导配对演化和自适应预算分配协调组件群体。我们在选择超启发式和分组件蚁群优化四个组合优化领域上评估了MuEvo。结果表明,MuEvo持续优于人工设计框架,并超越代表性最先进的多组件扩展式LLM-AHD方法,在控制器介导的启发式池和功能差异化的算法组件中均表现出色。
原文摘要 · Abstract (English)
Large language model-based automated heuristic design (LLM-AHD) has shown strong potential in discovering effective heuristics for combinatorial optimization problems. However, existing methods primarily optimize a single heuristic, whereas practical optimization frameworks often rely on multiple interacting components. Directly extending single-heuristic methods is challenging because early component selection can overlook components with late potential, while independent evolution ignores inter-component dependencies. We propose MuEvo, an LLM-driven framework for evolving heuristic ensembles under ensemble-level feedback. MuEvo combines Dynamic Component Management, which uses short-budget probing and a reversible lifecycle to revise component priorities throughout the search, with LLM-Driven Co-Evolution, which coordinates component populations through Multi-Ensemble Evaluation, Cross-Component Information Sharing, Relation-Guided Pair Evolution, and Adaptive Budget Allocation. We evaluate MuEvo on selection hyper-heuristics and componentized ant colony optimization across four combinatorial optimization domains. Results show that MuEvo consistently improves human-designed frameworks and outperforms representative multi-component extensions of state-of-the-art LLM-AHD methods, demonstrating its effectiveness across both controller-mediated heuristic pools and functionally differentiated algorithmic components.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。