让机器人实时感知脚下地形,自适应调整步态,稳稳走楼梯过断层。
Gait-Adaptive Perceptive Humanoid Locomotion with Real-Time Under-Base Terrain Reconstruction
- 用底部摄像头+U-Net实时生成脚底高度图,同步控制
- 在31自由度机器人上实现上下楼梯、跨46厘米缝隙
- 单阶段师生训练提升学习效率,适合复杂地形任务
对于全尺寸人形机器人,即使在强化学习控制方面取得进展,要在复杂地形(如长台阶)上实现可靠行走仍具挑战。此类场景中,感知受限、地形线索模糊以及步态时序适应不足,可能导致一次踏错或步态失误即迅速失衡。本文提出一种融合地形感知、步态调节与全身控制的感知式行走框架,通过安装于机器人基座下方的深度相机观测足部周围支撑区域,采用轻量级U-Net在每帧中实时重建密集的本体高度图,处理频率与控制环相同。该感知高度图与本体感知信息共同输入统一策略网络,生成关节指令与全局步态相位信号,使步态时序与全身姿态能联合适应指令运动和局部地形几何。进一步采用单阶段连续师生训练方案实现高效策略学习与知识迁移。实验在31自由度、身高1.65米的人形机器人上完成,验证了其在仿真与真实环境中的鲁棒性,涵盖前向/后向上下台阶及跨越46厘米间隙等复杂任务。
原文摘要 · Abstract (English)
For full-size humanoid robots, even with recent advances in reinforcement learning-based control, achieving reliable locomotion on complex terrains, such as long staircases, remains challenging. In such settings, limited perception, ambiguous terrain cues, and insufficient adaptation of gait timing can cause even a single misplaced or mistimed step to result in rapid loss of balance. We introduce a perceptive locomotion framework that merges terrain sensing, gait regulation, and whole-body control into a single reinforcement learning policy. A downward-facing depth camera mounted under the base observes the support region around the feet, and a compact U-Net reconstructs a dense egocentric height map from each frame in real time, operating at the same frequency as the control loop. The perceptual height map, together with proprioceptive observations, is processed by a unified policy that produces joint commands and a global stepping-phase signal, allowing gait timing and whole-body posture to be adapted jointly to the commanded motion and local terrain geometry. We further adopt a single-stage successive teacher-student training scheme for efficient policy learning and knowledge transfer. Experiments conducted on a 31-DoF, 1.65 m humanoid robot demonstrate robust locomotion in both simulation and real-world settings, including forward and backward stair ascent and descent, as well as crossing a 46 cm gap. Project Page:https://ga-phl.github.io/
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。