用内在动机提升机器人设计生成效率与多样性
Efficient and Diverse Generative Robot Designs using Evolution and Intrinsic Motivation
- 结合进化算法与内在动机,实现快速探索
- 生成设计更优、更多样,耗时显著减少
- 适合复杂任务的自动化机器人设计
机器人物理构型的生成式设计方法可自动寻找复杂环境中的最优且创新的解决方案。搜索空间涵盖物理结构空间与控制器参数空间,属于机器学习与优化的难题。进化算法(EAs)在无梯度优化中表现出色。形态进化与学习(MEL)利用EAs同时生成机器人设计并学习控制器最优参数。但其面临两大挑战:计算成本高,易过早收敛至次优解。为此,本文提出将形态进化与内在动机结合。内在动机源于身体化和简单学习规则,无需外部指导。采用自稳态控制器,仅需数秒即可生成探索性行为,且对机器人设计知识需求低。自稳态机制替代高成本学习阶段,显著降低计算时间,促进多样性,防止过早收敛。我们在多个下游任务中对比该方法与现有MEL方法,结果表明生成设计在所有任务中得分更高,更具多样性,且生成速度更快。
原文摘要 · Abstract (English)
Methods for generative design of robot physical configurations can automatically find optimal and innovative solutions for challenging tasks in complex environments. The vast search-space includes the physical design-space and the controller parameter-space, making it a challenging problem in machine learning and optimisation in general. Evolutionary algorithms (EAs) have shown promising results in generating robot designs via gradient-free optimisation. Morpho-evolution with learning (MEL) uses EAs to concurrently generate robot designs and learn the optimal parameters of the controllers. Two main issues prevent MEL from scaling to higher complexity tasks: computational cost and premature convergence to sub-optimal designs. To address these issues, we propose combining morpho-evolution with intrinsic motivations. Intrinsically motivated behaviour arises from embodiment and simple learning rules without external guidance. We use a homeokinetic controller that generates exploratory behaviour in a few seconds with reduced knowledge of the robot's design. Homeokinesis replaces costly learning phases, reducing computational time and favouring diversity, preventing premature convergence. We compare our approach with current MEL methods in several downstream tasks. The generated designs score higher in all the tasks, are more diverse, and are quickly generated compared to morpho-evolution with static parameters.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。