arXiv:2512.03762cs.AI2025-12被引 1

用多角色协作让大模型自动设计更优启发式算法

RoCo: Role-Based LLMs Collaboration for Automatic Heuristic Design

  • 四类角色协同:探索者、利用者、批评者、整合者分工合作
  • 在五类组合优化问题上表现超越ReEvo和HSEvo,白盒黑盒皆优
  • 适合需要自动化算法设计的研究者和工程实践者

自动启发式设计(AHD)已成为解决组合优化问题(COPs)的有前景方案。大语言模型(LLMs)在实现AHD方面展现出潜力,但现有研究多仅考虑单一角色。本文提出RoCo,一种基于多智能体的角色协作系统,通过多角色协同提升AHD的多样性和质量。RoCo协调四类专用的LLM引导代理——探索者、利用者、批评者和整合者——共同生成高质量启发式算法。探索者通过创造性、多样性驱动的思维促进长期潜力,利用者则聚焦短期改进,以保守、效率导向的方式进行优化。批评者评估每一步演进的有效性,并提供针对性反馈与反思。整合者融合探索者与利用者的提案,在创新与利用间取得平衡,推动整体进展。这些代理通过包含反馈、精炼和精英突变的结构化多轮过程交互,受短期与累积长期反思指导。我们在五种不同COPs上,于白盒与黑盒设置下评估RoCo。实验结果表明,RoCo性能优越,始终生成优于现有方法(包括ReEvo和HSEvo)的竞争力启发式算法,无论在白盒还是黑盒场景中。这一角色协作范式为鲁棒且高性能的AHD建立了新标准。

原文摘要 · Abstract (English)

Automatic Heuristic Design (AHD) has gained traction as a promising solution for solving combinatorial optimization problems (COPs). Large Language Models (LLMs) have emerged and become a promising approach to achieving AHD, but current LLM-based AHD research often only considers a single role. This paper proposes RoCo, a novel Multi-Agent Role-Based System, to enhance the diversity and quality of AHD through multi-role collaboration. RoCo coordinates four specialized LLM-guided agents-explorer, exploiter, critic, and integrator-to collaboratively generate high-quality heuristics. The explorer promotes long-term potential through creative, diversity-driven thinking, while the exploiter focuses on short-term improvements via conservative, efficiency-oriented refinements. The critic evaluates the effectiveness of each evolution step and provides targeted feedback and reflection. The integrator synthesizes proposals from the explorer and exploiter, balancing innovation and exploitation to drive overall progress. These agents interact in a structured multi-round process involving feedback, refinement, and elite mutations guided by both short-term and accumulated long-term reflections. We evaluate RoCo on five different COPs under both white-box and black-box settings. Experimental results demonstrate that RoCo achieves superior performance, consistently generating competitive heuristics that outperform existing methods including ReEvo and HSEvo, both in white-box and black-box scenarios. This role-based collaborative paradigm establishes a new standard for robust and high-performing AHD.

自动设计大模型组合优化多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。