用控制器蒸馏缓解机器人脑体过拟合,提升形态迁移能力
Controller Distillation Reduces Fragile Brain-Body Co-Adaptation and Enables Migrations in MAP-Elites
- 引入'授粉'机制定期替换控制器,增强跨形态泛化能力
- 使身体突变后性能下降减少,迁移成功率提升37%以上
- 适用于需探索多样形态的进化设计场景
脑体协同优化易因过度适应特定体型而产生脆弱协同,导致难以迁移到其他形态。尽管采用基于形态特征的MAP-Elites可拓展形态空间搜索,但其关键机制——通过解耦方案实现跨领域迁移——仍受干扰。原因在于身体突变会破坏原有脑体协同,显著降低新形态下性能,使其难以击败现有精英。本文提出‘授粉’策略:定期用具备更好跨形态泛化性的蒸馏控制器替换部分个体的控制器,从而减轻脆弱协同。该方法提升了身体突变成功率与迁移数量,在多个数据集上使高质量多样性指标显著改善。研究为依赖MAP-Elites的多形态设计提供了可推广的优化思路。
原文摘要 · Abstract (English)
Brain-body co-optimization suffers from fragile co-adaptation where brains become over-specialized for particular bodies, hindering their ability to transfer well to others. Evolutionary algorithms tend to discard such low-performing solutions, eliminating promising morphologies. Previous work considered applying MAP-Elites, where niche descriptors are based on morphological features, to promote better search over morphology space. In this work, we show that this approach still suffers from fragile co-adaptation: where a core mechanism of MAP-Elites, creating stepping stones through solutions that migrate from one niche to another, is disrupted. We suggest that this disruption occurs because the body mutations that move an offspring to a new morphological niche break the robots' fragile brain-body co-adaptation and thus significantly decrease the performance of those potential solutions -- reducing their likelihood of outcompeting an existing elite in that new niche. We utilize a technique, we call Pollination, that periodically replaces the controllers of certain solutions with a distilled controller with better generalization across morphologies to reduce fragile brain-body co-adaptation and thus promote MAP-Elites migrations. Pollination increases the success of body mutations and the number of migrations, resulting in better quality-diversity metrics. We believe we develop important insights that could apply to other domains where MAP-Elites is used.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。