小尺寸四足机器人在复杂地形上实现高效稳定行走
Robust Reinforcement Learning-Based Locomotion for Resource-Constrained Quadrupeds with Exteroceptive Sensing
- 用强化学习结合外部感知实时构建地形高程图
- 可爬17.5厘米台阶,22.5厘米台阶成功率80%
- 无需视觉惯性里程计仍能稳定运行,适合低算力平台
小型四足机器人在真实场景中的应用日益广泛,其紧凑尺寸便于融入人类环境。然而,在不平整地形上的实时行走仍具挑战,主要源于地形感知的高计算需求。本文提出一种面向资源受限小型四足机器人的鲁棒强化学习外部感知行走控制器,利用实时高程地图,并通过精心选择深度传感器支持。我们同时训练策略与状态估计器,共同提供里程计用于高程地图构建,可选融合视觉惯性里程计(VIO)。实验表明,增设一个飞行时间传感器可显著提升鲁棒性,即使无VIO也能稳定运行,从而释放计算资源。所提控制器在有无VIO条件下均能完美通过最高17.5厘米台阶,22.5厘米台阶成功率达80%。同时实现最大1.0米/秒前向速度和1.5弧度/秒偏航速度的精确跟踪。训练代码已开源:github.com/ETH-PBL/elmap-rl-controller。
原文摘要 · Abstract (English)
Compact quadrupedal robots are proving increasingly suitable for deployment in real-world scenarios. Their smaller size fosters easy integration into human environments. Nevertheless, real-time locomotion on uneven terrains remains challenging, particularly due to the high computational demands of terrain perception. This paper presents a robust reinforcement learning-based exteroceptive locomotion controller for resource-constrained small-scale quadrupeds in challenging terrains, which exploits real-time elevation mapping, supported by a careful depth sensor selection. We concurrently train both a policy and a state estimator, which together provide an odometry source for elevation mapping, optionally fused with visual-inertial odometry (VIO). We demonstrate the importance of positioning an additional time-of-flight sensor for maintaining robustness even without VIO, thus having the potential to free up computational resources. We experimentally demonstrate that the proposed controller can flawlessly traverse steps up to 17.5 cm in height and achieve an 80% success rate on 22.5 cm steps, both with and without VIO. The proposed controller also achieves accurate forward and yaw velocity tracking of up to 1.0 m/s and 1.5 rad/s respectively. We open-source our training code at github.com/ETH-PBL/elmap-rl-controller.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。