让机器人进化时既多样又高效,靠代际更替加学习机制。
Generational Replacement and Learning for High-Performing and Diverse Populations in Evolvable Robots
- 用代际完全替换+个体内学习提升多样性
- 性能不降反升,突破传统权衡限制
- 强调评估方式影响结论,需谨慎设计指标
进化机器人可通过协同优化形态与控制自动设计出解决特定任务的机器人。然而,由于控制器需时间适应不断进化的形态,新且有潜力的设计难以进入种群。解决方法是在每个个体中引入体内学习(即额外的控制器优化循环)。另一个问题是种群多样性不足,因进化过快聚焦于少数优秀设计。通过全代替换(后代完全取代亲代)可缓解此问题,但通常以牺牲性能为代价。本文表明,将全代替换与体内学习结合,既能提升多样性,又能保持高性能。同时强调评估方式的重要性:按功能评估与按进化代数评估可能得出不同结论。
原文摘要 · Abstract (English)
Evolutionary Robotics offers the possibility to design robots to solve a specific task automatically by optimizing their morphology and control together. However, this co-optimization of body and control is challenging, because controllers need some time to adapt to the evolving morphology - which may make it difficult for new and promising designs to enter the evolving population. A solution to this is to add intra-life learning, defined as an additional controller optimization loop, to each individual in the evolving population. A related problem is the lack of diversity often seen in evolving populations as evolution narrows the search down to a few promising designs too quickly. This problem can be mitigated by implementing full generational replacement, where offspring robots replace the whole population. This solution for increasing diversity usually comes at the cost of lower performance compared to using elitism. In this work, we show that combining such generational replacement with intra-life learning can increase diversity while retaining performance. We also highlight the importance of performance metrics when studying learning in morphologically evolving robots, showing that evaluating according to function evaluations versus according to generations of evolution can give different conclusions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。