arXiv:2607.28947cs.LG2026-07被引 2

用多样编辑重组提升大模型编程优化效率,突破单一坏编辑导致整体失败的瓶颈。

Overcoming the Weakest-Link Effect in LLM-Driven Program Optimization via Heterogeneous Edit Recombination

论文配图:Overcoming the Weakest-Link Effect in LLM-Driven Program Optimization via Heterogeneous Edit Recombination
图 1 · 摘自论文原文
  • 通过生成多样非重叠原子编辑,再按评分筛选组合,实现零阶优化
  • 在算法、游戏、智能体系统和机器人路径规划中均提升性能且更快收敛
  • 减少无效编辑影响,降低对精确梯度依赖,适合复杂程序优化场景

大型语言模型(LLMs)正通过搜索程序空间解决复杂问题,为可自然表达为程序的科学问题提供通用范式。尽管已有进展,但识别有效优化方向仍具挑战。现有方法常使用文本形式的“梯度”引导搜索,即基于先前评估程序或模型反馈生成的一阶更新方向。然而,随着程序-得分映射复杂度上升,此类估计可靠性下降。本文认为显式梯度并非必需;借助先验知识,LLMs 可直接从当前程序提出合理原子编辑,实现零阶优化策略。但零阶搜索存在“最弱链效应”:一组编辑整体被接受或拒绝时,单个有害编辑会抵消全部收益。为此,我们提出 HERO,通过提示 LLM 生成多样化、非重叠的原子编辑,并利用评估器分数系统性选择与组合,形成连贯改进。我们在算法问题、策略游戏、基于 LLM 的智能体系统设计及机器人路径规划中评估 HERO。结果表明,其在各领域持续发现更高分程序,收敛速度显著快于现有方法,且消耗更少令牌。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly used to solve complex problems by searching over program space, offering a general paradigm for scientific problems that can be naturally represented and solved as programs. Despite recent progress, identifying effective optimization directions for a candidate program remains challenging. By analogy with automatic differentiation, existing methods typically guide the search using a textual ``gradient'': a first-order update direction expressed as textual edits. Such gradients are inferred either from previously evaluated programs or from LLM-generated feedback on the implicit program-score mapping. However, these estimates become increasingly unreliable as the program--score mapping grows more complex, limiting their practical utility. We argue that explicit gradients are not essential for effective program optimization. Leveraging their prior knowledge, LLMs can propose plausible atomic edits directly from the current program, thereby enabling a zeroth-order optimization strategy. However, zeroth-order search suffers from a \textit{weakest-link effect}: when a bundle of edits is accepted or rejected as a whole, a single harmful edit can negate the benefits of all remaining edits. To address this issue, we introduce HERO, a program optimizer that prompts an LLM to generate diverse, non-overlapping atomic edits and then systematically selects and composes them into coherent program improvements using evaluator scores. We evaluate HERO across algorithmic problems, strategy games, the design of LLM-based agentic systems, and robotic path planning. Across these domains, HERO consistently discovers higher-scoring programs and converges substantially faster than prior LLM-based optimizers, while consuming fewer tokens.

程序优化大模型零阶优化智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。