让仿人机器人高速安全爬楼梯,靠的是规划引导的分阶段学习。
FastStair: Learning to Run Up Stairs with Humanoid Robots
- 用模型规划器引导强化学习,优先探索动态可行的踏步位置。
- 在奥利机器人上实现最高1.65米/秒速度,12秒内走完33阶螺旋楼梯。
- 适合追求高速稳定运动控制的机器人研发者参考。
对人类而言,跑上楼梯轻而易举,但对仿人机器人却极为困难,因其需同时具备高敏捷性与严格稳定性。基于模型的强化学习(RL)可生成动态行走行为,但隐含的稳定性奖励和对任务特定奖励设计的依赖常导致不安全动作,尤其在楼梯场景;相反,基于模型的落脚点规划器能编码接触可行性与稳定性结构,但强制执行其硬约束往往引发保守运动,限制速度。本文提出FastStair,一种由规划器引导的多阶段学习框架,融合两者优势,实现快速且稳定的楼梯攀爬。该方法将并行的模型基落脚点规划器融入强化学习训练循环,引导探索朝向动态可行的接触点,并预训练出以安全为核心的基线策略。为缓解规划器带来的保守性及低速与高速动作分布间的差异,基线策略被微调为速度特化的专家策略,并通过低秩适应(LoRA)整合,实现全速命令范围内的平滑运行。我们在奥利(Oli)仿人机器人上部署该控制器,实现了最高达1.65米/秒的稳定楼梯攀爬速度,在33阶螺旋楼梯(每阶17厘米升高)上仅用12秒完成,验证了长楼梯下高速鲁棒性能。值得注意的是,该方案在广州塔机器人爬楼竞赛中成为冠军解决方案。
原文摘要 · Abstract (English)
Running up stairs is effortless for humans but remains extremely challenging for humanoid robots due to the simultaneous requirements of high agility and strict stability. Model-free reinforcement learning (RL) can generate dynamic locomotion, yet implicit stability rewards and heavy reliance on task-specific reward shaping tend to result in unsafe behaviors, especially on stairs; conversely, model-based foothold planners encode contact feasibility and stability structure, but enforcing their hard constraints often induces conservative motion that limits speed. We present FastStair, a planner-guided, multi-stage learning framework that reconciles these complementary strengths to achieve fast and stable stair ascent. FastStair integrates a parallel model-based foothold planner into the RL training loop to bias exploration toward dynamically feasible contacts and to pretrain a safety-focused base policy. To mitigate planner-induced conservatism and the discrepancy between low- and high-speed action distributions, the base policy was fine-tuned into speed-specialized experts and then integrated via Low-Rank Adaptation (LoRA) to enable smooth operation across the full commanded-speed range. We deploy the resulting controller on the Oli humanoid robot, achieving stable stair ascent at commanded speeds up to 1.65 m/s and traversing a 33-step spiral staircase (17 cm rise per step) in 12 s, demonstrating robust high-speed performance on long staircases. Notably, the proposed approach served as the champion solution in the Canton Tower Robot Run Up Competition.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。