arXiv:2502.10862cs.RO2025-02被引 11

通过形态预训练,快速生成通用机器人控制器,实现设计迭代的零样本进化。

Accelerated co-design of robots through morphological pretraining

  • 利用可微分仿真进行梯度优化,直接获得无需重训练的通用控制策略。
  • 零样本进化使设计修改后能立即评估优劣,效率远超传统联合优化方法。
  • 适合机器人结构设计、自动化系统优化的研究者快速验证新构型。

机器人形态与神经控制的协同设计通常需对每种构型使用强化学习近似唯一控制策略梯度,耗费大量训练数据以评估性能。本文展示:通过可微分仿真进行梯度优化,可快速直接获得一种通用且与形态无关的控制器。该形态预训练过程使设计者能够对物理布局进行不可微分的修改(如增删重组离散部件),并立即利用预训练模型判断修改是否有益。我们称此为“零样本进化”,并与通用控制器与演化设计种群同时优化的方法对比。发现后者导致多样性崩溃——种群及控制器训练数据趋同于易于控制的相似设计。而采用预训练控制器的零样本进化能迅速生成多样化高性能设计;通过在进化过程中持续微调预训练控制器,多样性不仅得以保留,还显著提升,同时实现更优性能。

原文摘要 · Abstract (English)

The co-design of robot morphology and neural control typically requires using reinforcement learning to approximate a unique control policy gradient for each body plan, demanding massive amounts of training data to measure the performance of each design. Here we show that a universal, morphology-agnostic controller can be rapidly and directly obtained by gradient-based optimization through differentiable simulation. This process of morphological pretraining allows the designer to explore non-differentiable changes to a robot's physical layout (e.g. adding, removing and recombining discrete body parts) and immediately determine which revisions are beneficial and which are deleterious using the pretrained model. We term this process "zero-shot evolution" and compare it with the simultaneous co-optimization of a universal controller alongside an evolving design population. We find the latter results in diversity collapse, a previously unknown pathology whereby the population -- and thus the controller's training data -- converges to similar designs that are easier to steer with a shared universal controller. We show that zero-shot evolution with a pretrained controller quickly yields a diversity of highly performant designs, and by fine-tuning the pretrained controller on the current population throughout evolution, diversity is not only preserved but significantly increased as superior performance is achieved.

机器人设计零样本进化可微分仿真协同优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。