用大模型生成可解释的程序化控制策略,提升系统透明度与可调性。
Synthesizing Interpretable Control Policies through Large Language Model Guided Search
- 将大模型与进化算法结合,用标准编程语言生成控制程序。
- 在摆杆上举和球入杯任务中实现复杂行为,策略可读性强。
- 适合需要可解释性与人工干预的机器人控制场景。
大型语言模型(LLMs)、系统评估与进化算法的结合,已在组合优化和科学发现中取得突破。本文将其拓展至动态系统控制领域,提出一种生成可解释控制策略的新方法。我们以标准编程语言(如Python)表示控制策略,并在仿真环境中评估候选控制器,利用预训练大模型进行演化。与依赖黑箱神经网络的传统学习型控制方法不同,本方法仅在策略设计阶段使用大模型,确保系统各组件全程可解释且运行时易于验证。此外,采用标准编程语言使人类能基于专业经验轻松微调或调整控制器。我们在摆杆上举和球入杯任务中展示了该方法的有效性。代码已公开于 https://github.com/muellerlab/synthesizing_interpretable_control_policies.git。
原文摘要 · Abstract (English)
The combination of Large Language Models (LLMs), systematic evaluation, and evolutionary algorithms has enabled breakthroughs in combinatorial optimization and scientific discovery. We propose to extend this powerful combination to the control of dynamical systems, generating interpretable control policies capable of complex behaviors. With our novel method, we represent control policies as programs in standard languages like Python. We evaluate candidate controllers in simulation and evolve them using a pre-trained LLM. Unlike conventional learning-based control techniques, which rely on black-box neural networks to encode control policies, our approach enhances transparency and interpretability. We still take advantage of the power of large AI models, but only at the policy design phase, ensuring that all system components remain interpretable and easily verifiable at runtime. Additionally, the use of standard programming languages makes it straightforward for humans to finetune or adapt the controllers based on their expertise and intuition. We illustrate our method through its application to the synthesis of an interpretable control policy for the \textit{pendulum swing-up} and the \textit{ball in cup} tasks. We make the code available at https://github.com/muellerlab/synthesizing_interpretable_control_policies.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。