arXiv:2410.10621cs.RO2024-10被引 10

让四足机器人学会根据自身能力判断地形难易,真实环境训练下自主避障导航。

Traversability-Aware Legged Navigation by Learning from Real-World Visual Data

  • 用机器人运动控制器的值函数做地形可通行性评估,更贴近真实能力。
  • 在真实环境中通过少量试错高效学习,实现复杂地形自主导航。
  • 支持未见过场景泛化,适合实际部署的腿式机器人导航任务。

四足机器人凭借灵活的步态可在复杂非结构化环境中移动,但如何在提升机动性的同时考虑不同地形带来的能耗差异仍是难题。以往方法依赖人工标注的环境特征进行可通行性估计,但未考虑机器人控制器在挑战性地形上的实际表现差异。为此,本文提出一种基于机器人运动控制器值函数的新型可通行性估计算法,构建了基于学习的RGBD导航框架。该框架采用多阶段训练策略,结合在线与离线数据,利用样本高效的强化学习方法在真实世界中直接训练导航规划器,使机器人能避开障碍物和难行地形并抵达目标。实验表明,该方法在准确估计可通行性成本及从多模态数据(包括颜色与深度视觉、本体感知反馈)中高效学习方面表现最佳。使用该方法,四足机器人能在多种具有挑战性的真实环境地形中通过试错完成可通行性感知导航,并具备对未见场景的泛化能力。

原文摘要 · Abstract (English)

The enhanced mobility brought by legged locomotion empowers quadrupedal robots to navigate through complex and unstructured environments. However, optimizing agile locomotion while accounting for the varying energy costs of traversing different terrains remains an open challenge. Most previous work focuses on planning trajectories with traversability cost estimation based on human-labeled environmental features. However, this human-centric approach is insufficient because it does not account for the varying capabilities of the robot locomotion controllers over challenging terrains. To address this, we develop a novel traversability estimator in a robot-centric manner, based on the value function of the robot's locomotion controller. This estimator is integrated into a new learning-based RGBD navigation framework. The framework employs multiple training stages to develop a planner that guides the robot in avoiding obstacles and hard-to-traverse terrains while reaching its goals. The training of the navigation planner is directly performed in the real world using a sample efficient reinforcement learning method that utilizes both online data and offline datasets. Through extensive benchmarking, we demonstrate that the proposed framework achieves the best performance in accurate traversability cost estimation and efficient learning from multi-modal data (including the robot's color and depth vision, as well as proprioceptive feedback) for real-world training. Using the proposed method, a quadrupedal robot learns to perform traversability-aware navigation through trial and error in various real-world environments with challenging terrains that are difficult to classify using depth vision alone. Moreover, the robot demonstrates the ability to generalize the learned navigation skills to unseen scenarios. Video can be found at https://youtu.be/RSqnIWZ1qks.

四足机器人导航强化学习可通行性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。