arXiv:2503.02249cs.ROcs.AI2025-03被引 2

用大模型模拟自然选择,自动设计高性能软体机器人。

Natural Selection via Foundation Models for Soft Robot Evolution

  • 构建新基准RoboCrafter-QA,评估大模型从任务描述生成机器人结构的能力。
  • 微调后模型在设计选择和形态生成上达到顶尖水平,显著优于原始大模型。
  • 物理原型验证显示仿真性能与真实表现高度一致,适合机器人设计新手和研究者。

软体机器人设计过程复杂且高度迭代,需融合材料科学、力学与控制等多学科知识,常依赖直觉与大量实验。尽管大语言模型(LLM)具备强大推理能力,其在具身设计中的应用仍待探索。本文提出RoboCrafter-QA新基准,用于评估LLM能否学习软体机器人设计的表征,以连接高层任务描述与底层形态及材料选择。该基准基于EvoGym模拟器,涵盖运动、抓取与平衡等多样化设计挑战。对主流多模态大模型的实验表明,尽管其具备一定设计表征学习能力,但在细微性能差异的设计区分上仍显不足。为此,我们微调了一个高效开源的LLM,使其在本基准上达到最先进水平,展现出卓越的设计选择与直接生成高性能机器人形态的能力。此外,我们构建了模块化软体机器人的实物原型,验证了仿真与现实间的强相关性,证明优秀基准表现可转化为有效的实际设计选择。完整系统将开源,推动该方向发展。

原文摘要 · Abstract (English)

Designing soft robots is a complex and iterative process that demands cross-disciplinary expertise in materials science, mechanics, and control, often relying on intuition and extensive experimentation. While foundation models, especially Large Language Models (LLMs), have demonstrated impressive reasoning abilities, their capacity to conduct embodied design remains largely unexplored. This paper introduces RoboCrafter-QA, a novel benchmark to evaluate whether LLMs can learn representations of soft robot designs that effectively bridge the gap between high-level task descriptions and low-level morphological and material choices. RoboCrafter-QA leverages the EvoGym simulator to generate a diverse set of soft robot design challenges, spanning robotic locomotion, manipulation, and balancing tasks. Our experiments with SOTA multi-modal LLMs reveal that while these models exhibit promising capabilities in learning design representations, they struggle with fine-grained distinctions between designs with subtle performance differences. To overcome these limitations, we finetune an efficient, open-source LLM that achieves SOTA performance on our benchmark, demonstrating superior capabilities in both design selection and direct generation of high-performing robot morphologies. Furthermore, we construct a physical replica of the modular soft robot and demonstrate a strong sim-to-real correlation, validating that superior benchmark performance has the potential to translate to effective real-world design selection. Our full system will be open-sourced to foster this exciting direction.

软体机器人大模型设计自动化仿真到现实

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。