arXiv:2505.06218cs.ROcs.AI2025-05CVPR被引 11

让机器人像人一样在复杂山路上自主徒步,融合感知、决策与动作控制。

Let Humanoids Hike! Integrative Skill Development on Complex Trails

  • 用时序视觉变换器预测未来目标,实现导航与行走一体化。
  • 通过关节运动的潜在表征,提升训练策略向实际执行的迁移效果。
  • 无需预设动作,可适应多种地形和机器人结构,适合通用人形智能研究。

复杂山地徒步需要平衡、敏捷性和对不可预测地形的自适应决策能力。当前人形机器人研究仍分散且不足:运动控制聚焦局部技能而缺乏长期目标与情境感知;语义导航则忽视真实身体实现与局部地形变化。本文提出训练人形机器人在复杂山路上自主徒步,推动视觉感知、决策与运动执行的整合发展。我们构建了名为 LEGO-H 的学习框架,使配备视觉系统的机器人能自主穿越复杂路径。技术上提出两项创新:1)设计一种时序视觉变换器变体,嵌入分层强化学习框架,提前预测局部目标以引导行动,实现运动与目标导向导航的无缝结合;2)结合关节运动模式的潜在表示与分层度量学习,增强特权学习机制,实现从特权训练到机载执行的平滑策略迁移。该系统不依赖预定义动作模式,可应对多样化的物理与环境挑战。在多种模拟路径及不同机器人形态上的实验验证了 LEGO-H 的泛化性与鲁棒性,确立徒步作为具身自主性的有力测试基准,LEGO-H 成为未来人形机器人发展的基线方案。

原文摘要 · Abstract (English)

Hiking on complex trails demands balance, agility, and adaptive decision-making over unpredictable terrain. Current humanoid research remains fragmented and inadequate for hiking: locomotion focuses on motor skills without long-term goals or situational awareness, while semantic navigation overlooks real-world embodiment and local terrain variability. We propose training humanoids to hike on complex trails, driving integrative skill development across visual perception, decision making, and motor execution. We develop a learning framework, LEGO-H, that enables a vision-equipped humanoid robot to hike complex trails autonomously. We introduce two technical innovations: 1) A temporal vision transformer variant - tailored into Hierarchical Reinforcement Learning framework - anticipates future local goals to guide movement, seamlessly integrating locomotion with goal-directed navigation. 2) Latent representations of joint movement patterns, combined with hierarchical metric learning - enhance Privileged Learning scheme - enable smooth policy transfer from privileged training to onboard execution. These components allow LEGO-H to handle diverse physical and environmental challenges without relying on predefined motion patterns. Experiments across varied simulated trails and robot morphologies highlight LEGO-H's versatility and robustness, positioning hiking as a compelling testbed for embodied autonomy and LEGO-H as a baseline for future humanoid development.

人形机器人自主导航强化学习具身智能

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。