arXiv:2606.05880cs.RO2026-06被引 2

让机器人像人一样主动看路,实现复杂地形下的稳定行走

TAGA: Terrain-aware Active Gaze Learning for Generalizable Agile Humanoid Locomotion

论文配图:TAGA: Terrain-aware Active Gaze Learning for Generalizable Agile Humanoid Locomotion
图 1 · 摘自论文原文
  • 通过视觉与身体感知融合,让机器人主动聚焦关键地形
  • 在真实环境中实现1.2米最远越障距离,且抗干扰能力强
  • 仅靠强化学习就能自然生成看路行为,无需额外标注

在多样且复杂的地形上实现敏捷的人形机器人行走,需要广泛的感知覆盖和精确的局部几何理解。受人类行走时有选择性地观察相关地形的启发,我们提出TAGA——一种基于注意力机制的地形感知主动凝视学习框架。该框架融合视觉、本体感知与运动指令,引导模型学习预测性线索,并主动关注高度扫描中的特定区域,有选择地利用这些信息丰富的区域输入下游网络。这在有限机载计算资源下提升了观测的信息密度,从而实现对大尺度地形的精细化感知行走。我们发现,这种凝视行为可仅通过强化学习自然涌现,无需额外监督或显式引导,显著提升训练效率。最终训练出的策略在仿真与硬件上均表现出鲁棒且可泛化的行走能力,包括可靠的地形感知踏足选择、高台穿越、稀疏踏足穿越,以及目前报道中最长的1.2米真实世界越障距离,同时在严重感知干扰和环境扰动下仍保持稳定。

原文摘要 · Abstract (English)

Agile humanoid locomotion across diverse challenging terrain demands both wide perceptual coverage and precise local geometry understanding. Motivated by the way humans selectively look at relevant terrain during locomotion, we introduce TAGA, a Terrain-aware Active Gaze learning framework for Attention-based humanoid control. By fusing vision, proprioception, and motion commands, our framework guides the model to learn anticipatory cues and actively attend to specific areas of the height scan, selectively using these informative regions for the downstream network. This adaptively increases the information density of observations under tight onboard computational constraints, thus enabling fine-grained perceptive locomotion over larger-scale terrains. We find that such gaze behaviors can naturally emerge through reinforcement learning alone, without requiring additional supervision or explicit guidance, significantly improve training efficiency. As a result, the trained policy demonstrates robust and generalizable locomotion in simulation and on hardware, including reliable terrain-aware foothold selection, elevated-platform traversal, competitive sparse-foothold traversal, and the largest reported real-world gap traversal distance of 1.2m among perceptive humanoid locomotion systems, while maintaining stability under severe perceptual disturbances and environmental interference.

人形机器人主动感知强化学习越障行走

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。