用继承样本提升进化机器人控制器优化效率
Integrating Sample Inheritance into Bayesian Optimization for Evolutionary Robotics
- 将父代样本直接传递或重评估后给子代使用,实现控制策略传承
- 重评估父代最优样本使性能显著优于无继承基准
- 适合资源受限下快速迭代机器人形态设计的场景
在进化机器人领域,机器人形态与控制策略需协同优化。传统方法对每个新形态从零开始训练控制器,成本高昂。本文采用贝叶斯优化提升样本效率,并引入样本继承机制模拟拉马克式遗传。在控制器学习预算极低的前提下,对比两种继承方式:(1)直接传递父代所有样本作为先验;(2)在子代上重新评估父代最佳样本。结果表明,重评估策略表现最优,基于先验的继承也优于无继承。分析显示,尽管单个形态学习预算不足,但跨代积累的适应性可弥补缺陷。且继承效果主要惠及与父代相似的子代形态。此外,在更复杂环境中,演化出的步态更具稳定性。研究证明,继承机制可在不增加学习开销的前提下显著提升进化机器人设计效率。
原文摘要 · Abstract (English)
In evolutionary robotics, robot morphologies are designed automatically using evolutionary algorithms. This creates a body-brain optimization problem, where both morphology and control must be optimized together. A common approach is to include controller optimization for each morphology, but starting from scratch for every new body may require a high controller learning budget. We address this by using Bayesian optimization for controller optimization, exploiting its sample efficiency and strong exploration capabilities, and using sample inheritance as a form of Lamarckian inheritance. Under a deliberately low controller learning budget for each morphology, we investigate two types of sample inheritance: (1) transferring all the parent's samples to the offspring to be used as prior without evaluating them, and (2) reevaluating the parent's best samples on the offspring. Both are compared to a baseline without inheritance. Our results show that reevaluation performs best, with prior-based inheritance also outperforming no inheritance. Analysis reveals that while the learning budget is too low for a single morphology, generational inheritance compensates for this by accumulating learned adaptations across generations. Furthermore, inheritance mainly benefits offspring morphologies that are similar to their parents. Finally, we demonstrate the critical role of the environment, with more challenging environments resulting in more stable walking gaits. Our findings highlight that inheritance mechanisms can boost performance in evolutionary robotics without needing large learning budgets, offering an efficient path toward more capable robot design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。