arXiv:2608.03129cs.AI2026-08

针对大模型搜索中性能平均化问题,提出动态聚类与专用算法设计框架。

Beyond Average Performance: Dynamic Instance Clustering and Specialized Algorithm Design in LLM-Assisted Evolutionary Search

论文配图:Beyond Average Performance: Dynamic Instance Clustering and Specialized Algorithm Design in LLM-Assisted Evolutionary Search
图 1 · 摘自论文原文
  • 在进化搜索中动态聚类实例,利用评估数据无特征信号划分相似响应组
  • 在4个任务上提升尾部鲁棒性15.2%,整体性能提升7.1%且头部表现不降
  • 适合需高可靠性、应对异构实例的自动化算法设计场景

大语言模型辅助的进化搜索(LES)已成为自动化算法设计的强大范式。然而,现有方法主要优化平均性能,导致搜索资源集中于对平均值贡献大的实例,忽视其他实例,造成尾部鲁棒性弱、实际应用可靠性不足。为此,本文提出动态实例聚类与专用算法设计(DyCA)框架,采用无特征、结构感知机制,在异构实例分布下构建可靠算法组合。DyCA将实例聚类作为搜索过程中的共演化组件,利用累积评估数据作为无特征信号,逐步划分具有相似算法响应模式的实例。发现的聚类将混合目标分解为一系列结构感知的子目标,从而实现更细粒度、更自适应的专用算法设计引导。在四个具异构实例的算法设计任务上,实验表明DyCA优于当前最先进的LES基线,平均提升尾部鲁棒性15.2%,整体性能提升7.1%,同时保持竞争性的头部性能。

原文摘要 · Abstract (English)

Large Language Model-assisted Evolutionary Search (LES) has emerged as a powerful paradigm for automated algorithm design. However, existing LES methods primarily optimize for average performance, inherently directing search effort toward instances that contribute most to this metric while leaving others poorly served, resulting in weak tail robustness and limited real-world reliability. To address this limitation, we propose Dynamic Instance Clustering and Specialized Algorithm Design (DyCA), an LES framework with a feature-free, structure-aware mechanism for constructing reliable algorithm portfolios under heterogeneous instance distributions. DyCA treats instance clustering as a co-evolving component within the search process, reusing accumulated evaluation data as feature-free signals to progressively partition instances with similar algorithmic response patterns. The uncovered clusters decompose the mixed objective into a set of structure-aware sub-objectives, thereby enabling finer-grained and more adaptive guidance for specialized algorithm design. Experimental results across four algorithm design tasks with heterogeneous instances demonstrate that DyCA outperforms state-of-the-art LES baselines, improving tail robustness by an average of 15.2\% and overall performance by 7.1\% while maintaining competitive head performance.

算法设计进化搜索大模型鲁棒性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。