用大模型设计可运行的物理机器,通过仿真反馈优化结构。
Compositional Machine Design as Program Synthesis with LLMs
- 将机器设计转化为程序合成,用标准化零件组合成可执行程序。
- 强化学习微调后,在固定生成预算下找到性能更好的机器结构。
- 适合研究大模型在物理世界中的程序生成与迭代优化能力。
大型语言模型(LLMs)在编写和修改程序方面表现出色,但多数程序合成基准仍局限于符号或数字环境。本文提出组合式机器设计,一种基于物理仿真的程序合成形式:机器以程序形式编写,由标准化部件组合而成,成功与否由模拟物理行为决定。为此,我们构建了基于游戏Besiege的测试平台BesiegeField,让LLM代理从文本功能需求生成机器程序,在仿真中执行并接收奖励与状态反馈。我们在单智能体生成、迭代编辑和分层工作流三种模式下评估代表性任务。强模型能恢复相关结构,部分实现非平凡的物理性能,但常在空间精确装配、机制级规划及反馈转化方面表现不佳。我们进一步对开源模型Qwen2.5-14B进行基于仿真奖励的强化学习微调,在固定生成预算下,显著提升最优机器发现性能。同时评估人类表现,提供任务难度参考。这些结果确立了组合式机器设计作为研究可执行机器程序生成与物理反馈优化的测试平台。
原文摘要 · Abstract (English)
Large language models (LLMs) have shown strong abilities in writing and revising programs, yet many program-synthesis benchmarks still evaluate programs in symbolic or digital environments. We introduce compositional machine design, a physically grounded form of program synthesis where machines are written as programs that compose standardized parts, and success is determined by simulated physical behavior. To study this problem, we present BesiegeField, a testbed built on the machine-building game Besiege. In BesiegeField, LLM agents generate machine programs from textual functional demands, execute the resulting machines in simulation, and receive rewards and state feedback. We benchmark LLM agents across representative machine-design tasks under single-agent generation, iterative editing, and hierarchical workflows. Strong models recover task-relevant structures and sometimes achieve nontrivial physical performance, but often struggle with spatially precise assembly, mechanism-level planning, and translating feedback into useful structural edits. We further finetune Qwen2.5-14B, an open-source LLM, with reinforcement learning from simulation-derived rewards. We find that, under a fixed generation budget, RL improves the best machine discovered. We additionally evaluate human performance to provide a reference point for task difficulty. These results establish compositional machine design as a testbed for studying LLM agents that synthesize executable machine programs and improve them through physical feedback.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。