让机器人在复杂地形上自主行走,靠感知+学习实现稳定导航。
Learning Perceptive Humanoid Locomotion over Challenging Terrain
- 用教师-学生框架,让模型从理想数据中学习动作并自建世界模型。
- 在噪声环境中仍能准确估计地形,成功走完2公里复杂路线。
- 适合做智能机器人导航、具身智能研究的团队参考。
类人机器人需具备人类般的运动与感知能力以应对复杂地形。当前主流控制器仅依赖本体感知,在崎岖地形下易失效。尽管高程图可支持前瞻性步态规划,但其在外部感知噪声下的鲁棒性仍是难题。为此,我们提出一种基于教师-学生蒸馏的方案:教师策略利用无噪声数据生成最优行为参考;学生策略不仅模仿教师动作,还通过变分信息瓶颈训练世界模型,实现传感器去噪与状态估计。大量实验表明,该方法显著提升了在不可靠地形估计场景下的表现。我们在城市复杂环境和非铺装路面进行了严格测试,模型成功自主行进2公里,无需外部干预。
原文摘要 · Abstract (English)
Humanoid robots are engineered to navigate terrains akin to those encountered by humans, which necessitates human-like locomotion and perceptual abilities. Currently, the most reliable controllers for humanoid motion rely exclusively on proprioception, a reliance that becomes both dangerous and unreliable when coping with rugged terrain. Although the integration of height maps into perception can enable proactive gait planning, robust utilization of this information remains a significant challenge, especially when exteroceptive perception is noisy. To surmount these challenges, we propose a solution based on a teacher-student distillation framework. In this paradigm, an oracle policy accesses noise-free data to establish an optimal reference policy, while the student policy not only imitates the teacher's actions but also simultaneously trains a world model with a variational information bottleneck for sensor denoising and state estimation. Extensive evaluations demonstrate that our approach markedly enhances performance in scenarios characterized by unreliable terrain estimations. Moreover, we conducted rigorous testing in both challenging urban settings and off-road environments, the model successfully traverse 2 km of varied terrain without external intervention.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。