arXiv:2601.06845cs.AI2026-01被引 4

用大模型驱动的进化搜索,自动生成可读可控的代码化控制策略。

Code Evolution for Control: Synthesizing Policies via LLM-Driven Evolutionary Search

  • 将策略生成视为代码演化问题,结合大模型编程知识与进化搜索。
  • 生成的策略为紧凑可读代码,支持人工检查与形式化验证。
  • 适合需要可解释性与安全性的自动驾驶、机器人控制场景。

自主系统控制策略的设计仍是一大挑战,传统方法依赖强化学习或人工工程。强化学习虽成效显著,但样本复杂度高、奖励设计难,且生成的神经网络策略难以解释与验证;人工设计则需大量领域知识,难以跨任务扩展。本文提出一种基于大模型驱动的进化搜索方法,将策略合成转化为代码演化问题,利用大模型对编程模式与控制启发式知识的先验理解,并通过进化搜索系统探索解空间。我们构建了EvoToolkit框架,实现大模型演化与可定制评估的无缝集成。该方法迭代演化候选策略程序,依据任务目标评估并选择优胜个体进行繁殖,最终生成紧凑、人类可读的控制策略代码,可直接检查、修改与形式化验证。本工作展示了基础模型与进化计算结合在合成可信控制策略方面的潜力。代码开源:https://github.com/pgg3/EvoControl。

原文摘要 · Abstract (English)

Designing effective control policies for autonomous systems remains a fundamental challenge, traditionally addressed through reinforcement learning or manual engineering. While reinforcement learning has achieved remarkable success, it often suffers from high sample complexity, reward shaping difficulties, and produces opaque neural network policies that are hard to interpret or verify. Manual design, on the other hand, requires substantial domain expertise and struggles to scale across diverse tasks. In this work, we demonstrate that LLM-driven evolutionary search can effectively synthesize interpretable control policies in the form of executable code. By treating policy synthesis as a code evolution problem, we harness the LLM's prior knowledge of programming patterns and control heuristics while employing evolutionary search to explore the solution space systematically. We implement our approach using EvoToolkit, a framework that seamlessly integrates LLM-driven evolution with customizable fitness evaluation. Our method iteratively evolves populations of candidate policy programs, evaluating them against task-specific objectives and selecting superior individuals for reproduction. This process yields compact, human-readable control policies that can be directly inspected, modified, and formally verified. This work highlights the potential of combining foundation models with evolutionary computation for synthesizing trustworthy control policies in autonomous systems. Code is available at https://github.com/pgg3/EvoControl.

控制策略大模型进化搜索可解释性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。