仅用视觉与本体感知,让四足机器人在稀疏危险地形上稳定行走。
Walking with Terrain Reconstruction: Learning to Traverse Risky Sparse Footholds
- 通过局部地形重建,将深度图转化为带结构信息的高程图作为中间表示
- 在真实机器人上实现复杂稀疏地形的敏捷自适应行走,无需外部定位系统
- 方法轻量高效,适合低成本四足机器人部署
在稀疏且危险的地形上行走对腿式机器人构成重大挑战,需要精确地将脚放置在安全区域。以往研究依赖运动捕捉系统或建图技术生成高程图以指导运动策略,但这些方法需专用流程且常引入噪声。而来自本体视觉系统的深度图像虽成本低,但视场有限、信息稀疏,难以将地形结构细节融入隐式特征中,影响动作生成精度。本文证明,仅依赖本体感知与深度图像的端到端强化学习,即可有效穿越高稀疏性与随机性的危险地形。所提方法引入局部地形重建,利用高程图清晰的特征与充足信息作为视觉特征提取与运动生成的中介,使策略能有效表征并记忆关键地形信息。我们在低成本四足机器人上部署该框架,在多种复杂地形中实现敏捷自适应行走,展现出卓越的真实场景表现。视频见:youtu.be/Rj9v5EZsn-M。
原文摘要 · Abstract (English)
Traversing risky terrains with sparse footholds presents significant challenges for legged robots, requiring precise foot placement in safe areas. To acquire comprehensive exteroceptive information, prior studies have employed motion capture systems or mapping techniques to generate heightmap for locomotion policy. However, these approaches require specialized pipelines and often introduce additional noise. While depth images from egocentric vision systems are cost-effective, their limited field of view and sparse information hinder the integration of terrain structure details into implicit features, which are essential for generating precise actions. In this paper, we demonstrate that end-to-end reinforcement learning relying solely on proprioception and depth images is capable of traversing risky terrains with high sparsity and randomness. Our method introduces local terrain reconstruction, leveraging the benefits of clear features and sufficient information from the heightmap, which serves as an intermediary for visual feature extraction and motion generation. This allows the policy to effectively represent and memorize critical terrain information. We deploy the proposed framework on a low-cost quadrupedal robot, achieving agile and adaptive locomotion across various challenging terrains and showcasing outstanding performance in real-world scenarios. Video at: youtu.be/Rj9v5EZsn-M.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。