让机器人像人一样在复杂野外环境稳健跑跳,无需依赖外部定位系统。
Hiking in the Wild: A Scalable Perceptive Parkour Framework for Humanoids
- 用深度图和身体感知直接生成动作,不依赖外部定位。
- 实测可在2.5米/秒速度下穿越复杂地形,不滑倒不卡顿。
- 开源代码,适合做机器人运动控制与强化学习研究者使用。
实现类人机器人在复杂非结构化环境中的稳健徒步,需从反应式本体感知转向主动感知。然而,外感受器的整合仍是难题:基于地图的方法易出现状态估计漂移;例如,激光雷达方法对躯干抖动处理不佳。现有端到端方法常面临可扩展性差与训练复杂的问题,部分先前工作使用虚拟障碍物时仅适用于特定场景。本文提出《Hiking in the Wild》,一个可扩展的端到端攀爬感知框架,用于类人机器人稳健徒步。为确保安全与训练稳定,引入两项关键机制:结合可扩展的地形边缘检测与足部体积点的踏足安全机制,防止边缘滑落;以及平滑区域采样策略,通过生成可行导航目标缓解奖励劫持问题。方法采用单阶段强化学习,直接将原始深度输入与本体感知映射为关节动作,无需外部状态估计。大量实地实验表明,该策略使全尺寸类人机器人以最高2.5米/秒的速度稳健穿越复杂地形。训练与部署代码已开源,支持真实机器人快速复现与部署,仅需极少硬件改动。
原文摘要 · Abstract (English)
Achieving robust humanoid hiking in complex, unstructured environments requires transitioning from reactive proprioception to proactive perception. However, integrating exteroception remains a significant challenge: mapping-based methods suffer from state estimation drift; for instance, LiDAR-based methods do not handle torso jitter well. Existing end-to-end approaches often struggle with scalability and training complexity; specifically, some previous works using virtual obstacles are implemented case-by-case. In this work, we present \textit{Hiking in the Wild}, a scalable, end-to-end parkour perceptive framework designed for robust humanoid hiking. To ensure safety and training stability, we introduce two key mechanisms: a foothold safety mechanism combining scalable \textit{Terrain Edge Detection} with \textit{Foot Volume Points} to prevent catastrophic slippage on edges, and a \textit{Flat Patch Sampling} strategy that mitigates reward hacking by generating feasible navigation targets. Our approach utilizes a single-stage reinforcement learning scheme, mapping raw depth inputs and proprioception directly to joint actions, without relying on external state estimation. Extensive field experiments on a full-size humanoid demonstrate that our policy enables robust traversal of complex terrains at speeds up to 2.5 m/s. The training and deployment code is open-sourced to facilitate reproducible research and deployment on real robots with minimal hardware modifications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。