用视觉实现全向行走,无需昂贵渲染。
No More Blind Spots: Learning Vision-Based Omnidirectional Bipedal Locomotion for Challenging Terrain
- 用教师-学生框架替代传统强化学习,避免全向深度图渲染
- 训练速度提升10倍,实现在复杂地形上稳定全向移动
- 适合机器人行走控制、具身智能研究者参考
在动态环境(如杂乱室内或不平地形)中实现高效双足行走,需具备全向感知与适应性运动能力。传统方法依赖模拟中高成本的全向深度图渲染,难以实施端到端强化学习。本文提出一种基于视觉的全向双足行走学习框架,结合鲁棒的盲控策略与监督式视觉学生策略,通过噪声增强地形数据训练,避免了模拟中的全向渲染开销,并提升鲁棒性。我们引入一种新型数据增强技术,使训练速度相比传统方法加快10倍。框架在仿真与真实机器人测试中均验证有效,实现了对多样化地形的全向自主行走,据我们所知,这是首个展示基于视觉的全向双足行走的成果。
原文摘要 · Abstract (English)
Effective bipedal locomotion in dynamic environments, such as cluttered indoor spaces or uneven terrain, requires agile and adaptive movement in all directions. This necessitates omnidirectional terrain sensing and a controller capable of processing such input. We present a learning framework for vision-based omnidirectional bipedal locomotion, enabling seamless movement using depth images. A key challenge is the high computational cost of rendering omnidirectional depth images in simulation, making traditional sim-to-real reinforcement learning (RL) impractical. Our method combines a robust blind controller with a teacher policy that supervises a vision-based student policy, trained on noise-augmented terrain data to avoid rendering costs during RL and ensure robustness. We also introduce a data augmentation technique for supervised student training, accelerating training by up to 10 times compared to conventional methods. Our framework is validated through simulation and real-world tests, demonstrating effective omnidirectional locomotion with minimal reliance on expensive rendering. This is, to the best of our knowledge, the first demonstration of vision-based omnidirectional bipedal locomotion, showcasing its adaptability to diverse terrains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。