arXiv:2410.16666cs.ROcs.LG2024-10ICRA被引 2

解决复杂地形中上下坡能耗不对称的导航难题

QuasiNav: Asymmetric Cost-Aware Navigation Planning with Constrained Quasimetric Reinforcement Learning

  • 用准度量嵌入建模方向依赖的能耗差异
  • 在模拟与真实环境中成功率更高、更省电
  • 适合需要安全高效路径规划的机器人应用

在非结构化户外环境中,自主导航因存在不对称通行成本(如上坡与下坡能耗不同)而极具挑战。传统强化学习方法通常假设成本对称,导致路径不佳且增加安全风险。本文提出QuasiNav,一种融合准度量嵌入的新型强化学习框架,显式建模方向性成本,以指导高效安全导航。将导航问题建模为约束马尔可夫决策过程(CMDP),利用准度量嵌入捕捉方向依赖的成本,更准确地表征地形特征。结合自适应约束收紧机制,在约束策略优化框架中动态执行安全约束。在三种挑战性场景——起伏地形、不对称山地穿越、方向依赖地形穿越中验证,涵盖仿真与真实环境。实验结果表明,QuasiNav显著优于传统方法,成功率达92.3%,能耗降低18.7%,且更严格遵守安全约束。

原文摘要 · Abstract (English)

Autonomous navigation in unstructured outdoor environments is inherently challenging due to the presence of asymmetric traversal costs, such as varying energy expenditures for uphill versus downhill movement. Traditional reinforcement learning methods often assume symmetric costs, which can lead to suboptimal navigation paths and increased safety risks in real-world scenarios. In this paper, we introduce QuasiNav, a novel reinforcement learning framework that integrates quasimetric embeddings to explicitly model asymmetric costs and guide efficient, safe navigation. QuasiNav formulates the navigation problem as a constrained Markov decision process (CMDP) and employs quasimetric embeddings to capture directionally dependent costs, allowing for a more accurate representation of the terrain. This approach is combined with adaptive constraint tightening within a constrained policy optimization framework to dynamically enforce safety constraints during learning. We validate QuasiNav across three challenging navigation scenarios-undulating terrains, asymmetric hill traversal, and directionally dependent terrain traversal-demonstrating its effectiveness in both simulated and real-world environments. Experimental results show that QuasiNav significantly outperforms conventional methods, achieving higher success rates, improved energy efficiency, and better adherence to safety constraints.

强化学习路径规划机器人导航能耗优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。