让四足机器人像动物一样在稀疏地形上灵活行走。
START: Traversing Sparse Footholds with Terrain Reconstruction
- 用视觉和本体感知重建局部地形高度图,显式表征关键几何信息。
- 零样本迁移至多种真实场景,实现精准踏点与稳定行走。
- 无需复杂管道或高成本数据,适合实际部署的机器人系统。
在类似动物的稀疏落脚点地形上行进,对四足机器人而言既具前景又充满挑战,需精确环境感知与敏捷控制以确保安全踏点并维持动态稳定。基于模型的分层控制器在实验室表现优异,但泛化能力差且行为过于保守;端到端学习方法虽更具灵活性,但现有最佳方法依赖易引入噪声的高度图,或从自身体感深度图像隐式推断地形特征,常遗漏关键几何线索,导致学习效率低、步态僵硬。为此,我们提出START——一种单阶段学习框架,可在高度稀疏且随机分布的落脚点上实现敏捷、稳定的运动。START仅使用低成本机载视觉与本体感知,准确重建局部地形高度图,作为显式中间表示,传递稀疏落脚区域的关键特征,支持全面环境理解与精确地形评估,降低探索成本,加速技能习得。实验表明,START在多样真实场景中实现零样本迁移,展现卓越适应性、精准踏点与鲁棒运动性能。
原文摘要 · Abstract (English)
Traversing terrains with sparse footholds like legged animals presents a promising yet challenging task for quadruped robots, as it requires precise environmental perception and agile control to secure safe foot placement while maintaining dynamic stability. Model-based hierarchical controllers excel in laboratory settings, but suffer from limited generalization and overly conservative behaviors. End-to-end learning-based approaches unlock greater flexibility and adaptability, but existing state-of-the-art methods either rely on heightmaps that introduce noise and complex, costly pipelines, or implicitly infer terrain features from egocentric depth images, often missing accurate critical geometric cues and leading to inefficient learning and rigid gaits. To overcome these limitations, we propose START, a single-stage learning framework that enables agile, stable locomotion on highly sparse and randomized footholds. START leverages only low-cost onboard vision and proprioception to accurately reconstruct local terrain heightmap, providing an explicit intermediate representation to convey essential features relevant to sparse foothold regions. This supports comprehensive environmental understanding and precise terrain assessment, reducing exploration cost and accelerating skill acquisition. Experimental results demonstrate that START achieves zero-shot transfer across diverse real-world scenarios, showcasing superior adaptability, precise foothold placement, and robust locomotion.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。