arXiv:2606.05873cs.ROcs.AI2026-06被引 1

让机器人像人一样稳爬各种梯子,还能在上面干活

LadderMan: Learning Humanoid Perceptive Ladder Climbing

论文配图:LadderMan: Learning Humanoid Perceptive Ladder Climbing
图 1 · 摘自论文原文
  • 用两阶段学习法从单一动作数据中训练多个攀爬专家
  • 零样本迁移至真实机器人,在多种梯子上稳定攀爬
  • 结合视觉大模型解决仿真到现实的感知差距,适合复杂场景应用

类人机器人有望在人类环境中工作,但攀爬梯子仍极具挑战:立足点稀疏、全身协调复杂,且对感知与控制误差敏感。本文提出LadderMan,一个统一系统,使类人机器人能够稳健攀爬多种梯子并执行受约束条件下的操作任务。其攀爬策略基于可扩展的两阶段学习流程:利用混合运动追踪从单一参考动作中学习多个攀爬专家,并通过混合模仿与强化学习将这些专家压缩为基于深度图的统一视觉-运动策略。为实现真实部署,我们采用视觉基础模型缓解深度感知的仿真到现实差距。在此学习策略基础上,进一步通过双智能体架构训练独立的操作策略,支持通过远程操控实现梯子上的稳定操作。实验表明,LadderMan在多种梯度几何结构中实现稳健攀爬,能零样本迁移到真实硬件,并支持多种受限条件下的操作任务。视频结果见https://ladderman-robot.github.io。

原文摘要 · Abstract (English)

Humanoid robots hold great promise for operating in human-centered environments, yet ladder climbing remains one of the most challenging tasks due to sparse footholds and handholds, complex whole-body coordination, and sensitivity to perception and control errors. We present \textbf{LadderMan}, a unified system that enables humanoid robots to robustly climb diverse ladders and perform manipulation under such constrained conditions. Our climbing policy is built on a scalable two-stage learning pipeline, where we use hybrid motion tracking to learn multiple climbing experts from a single reference motion, and distill these experts into a unified depth-based visuomotor climbing policy via hybrid imitation and reinforcement learning. To enable real-world deployment, we leverage vision foundation models to bridge the sim-to-real gap in depth perception. Building on the learned climbing policy, we further train a separate manipulation policy using a dual-agent formulation, allowing stable on-ladder manipulation via teleoperation. Experiments demonstrate that LadderMan achieves robust ladder climbing across a wide range of geometries, successfully transfers to real-world hardware in a zero-shot manner, and supports various manipulation tasks under challenging ladder constraints. Video results are available at https://ladderman-robot.github.io .

类人机器人梯子攀爬视觉导航仿真实现

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。