arXiv:2512.13857cs.AIcs.CL2025-12被引 3

用图结构保存多个程序变体,让大模型更稳定地生成高质量代码。

EvoLattice: Persistent Internal-Population Evolution through Multi-Alternative Quality-Diversity Graph Representations for LLM-Guided Program Discovery

  • 将程序候选集建模为带多备选节点的有向无环图,避免重复结构
  • 通过路径统计分析局部设计对全局性能的影响,提升进化稳定性
  • 适合需要持续优化的代码生成与多智能体系统演化场景

大型语言模型(LLMs)被广泛用于程序与多智能体系统的演化,但现有方法多依赖单候选覆盖式变异,易丢弃有效变体、造成破坏性修改,且搜索空间脆弱。我们提出EvoLattice框架,将候选程序或智能体行为全体表示为单一有向无环图。每个节点存储多个持久化备选方案,每条有效路径对应一个可执行候选,实现组合式搜索空间而不复制结构。通过在所有路径中评估各备选项,实现细粒度替代级评价,生成反映局部设计对全局性能影响的统计数据。这些数据驱动反馈信号用于指导LLM进行变异、重组与剪枝,同时保留成功组件。结构正确性由独立于LLM的确定性自修复机制保障,确保无环性和依赖一致性。该框架自然扩展至智能体演化,将备选项解释为提示片段或子智能体行为。在程序合成(代理与优化器元学习)任务中,EvoLattice表现出更稳定的演化过程、更强表达能力及更优提升轨迹,其动态特性类似质量-多样性优化,但由内部多备选表示隐式生成,而非依赖显式外部存档。

原文摘要 · Abstract (English)

Large language models (LLMs) are increasingly used to evolve programs and multi-agent systems, yet most existing approaches rely on overwrite-based mutations that maintain only a single candidate at a time. Such methods discard useful variants, suffer from destructive edits, and explore a brittle search space prone to structural failure. We introduce EvoLattice, a framework that represents an entire population of candidate programs or agent behaviors within a single directed acyclic graph. Each node stores multiple persistent alternatives, and every valid path through the graph defines a distinct executable candidate, yielding a large combinatorial search space without duplicating structure. EvoLattice enables fine-grained alternative-level evaluation by scoring each alternative across all paths in which it appears, producing statistics that reveal how local design choices affect global performance. These statistics provide a dense, data-driven feedback signal for LLM-guided mutation, recombination, and pruning, while preserving successful components. Structural correctness is guaranteed by a deterministic self-repair mechanism that enforces acyclicity and dependency consistency independently of the LLM. EvoLattice naturally extends to agent evolution by interpreting alternatives as prompt fragments or sub-agent behaviors. Across program synthesis (proxy and optimizer meta-learning), EvoLattice yields more stable evolution, greater expressivity, and stronger improvement trajectories than prior LLM-guided methods. The resulting dynamics resemble quality-diversity optimization, emerging implicitly from EvoLattice's internal multi-alternative representation rather than an explicit external archive.

程序生成大模型演化质量多样性图结构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。