arXiv:2608.29769cs.RO2026-08

让机器人用激光雷达感知并敏捷穿越稀疏三维结构

Learning Agile Perceptive Traversal of Sparse 3D Structures for Humanoids

论文配图:Learning Agile Perceptive Traversal of Sparse 3D Structures for Humanoids
图 1 · 摘自论文原文
  • 用注意力编码器+循环记忆处理稀疏激光数据,实时提取关键几何信息
  • 硬件实验中15次尝试成功14次,横渡速度达0.5米/秒
  • 适用于复杂地形穿越,适合做机器人动态运动控制研究者参考

穿越稀疏3D结构要求人形机器人在执行敏捷、精确的全身动作时感知细长、悬空的几何结构。本文以猿跃式过杆为例,研究机器人需跳跃攀上结构,通过稀疏杆件交互横渡,并安全落地的任务。为此,我们提出一种基于强化学习的感知控制框架,直接使用头戴式固态激光雷达的观测数据。为从稀疏点云中提取任务相关几何信息,策略采用带有递归记忆的注意力编码器处理原始激光扫描。该策略通过分阶段的教师-学生训练流程获得,融合了跳跃上、猿跃、跳下三类专家知识。为实现硬件部署,建模了激光噪声、电池电压下降和执行器热限,并为人形机器人配备被动钩爪末端执行器以实现稳健的杆件交互。在真实硬件上,该策略在三种杆配置下完成完整跳上→猿跃→跳下序列的14/15次试验,猿跃速度最高达0.5米/秒。此外,相同的感知骨干网络支持另一独立训练的策略,可避开截面仅2厘米的低空薄障碍物。

原文摘要 · Abstract (English)

Traversing sparse 3D structures requires humanoid robots to perceive thin, overhanging geometry while executing agile, accurate whole-body motions. We study this problem through monkey-bar traversal, where the robot must jump to the structure, traverse it through sparse bar interactions, and land safely. For this task, we present a reinforcement-learning-based perceptive control system that operates directly on observations from a head-mounted solid-state lidar. To extract task-relevant geometry from the sparse returns, the policy consumes the raw lidar scan through an attention-based encoder with recurrent memory. This policy is obtained by a phase-scheduled teacher- student pipeline that combines privileged experts for jumping up, brachiating, and jumping down. For transfer to hardware, we model lidar noise, battery-voltage sag, and actuator thermal limits, and equip the humanoid with passive hook end-effectors for robust bar interaction. On hardware, the resulting policy completes the full jump-up->brachiation->jump-down sequence in 14 of 15 trials across three bar configurations and reaches brachiation speeds up to 0.5 m/s. Beyond brachiation, the same perception backbone supports a separately trained policy that ducks beneath thin overhead obstacles with 2 cm cross-sections.

人形机器人感知控制强化学习激光雷达

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。