用分区+强化学习提升高维路径规划效率,3倍快于传统方法。
Zonal RL-RRT: Integrated RL-RRT Path Planning with Collision Probability and Zone Connectivity
- 分区域管理环境,用Q-learning做高层决策
- 在森林地图中比RRT*快3倍,6维环境成功率稳定
- 适合机械臂等复杂系统,兼顾速度与可靠性
高维空间中的路径规划面临时间效率与成功率的双重挑战。为此,我们提出新型算法Zonal RL-RRT,通过kd-tree分割地图为多个区域并解决区域连通性问题,实现区域间无缝过渡。将复杂环境分解为多区域,并以Q-learning作为高层决策机制,使算法在林地类地图中相比基础采样方法(如RRT、RRT*)时间效率提升3倍。在2至6维环境中,运行时间较启发式方法(BIT*、Informed RRT*)快1.5倍,且保持稳健的成功率。相较于基于学习的方法(NeuralRRT*、MPNetSMP)及启发式RRT*J,平均性能提升1.5倍。我们在MuJoCo环境中对UR10e机械臂进行了仿真验证。本方法的核心在于区域划分与强化学习结合,实现自适应高层规划,支持灵活策略,适用于多样化复杂环境的先进路径规划。
原文摘要 · Abstract (English)
Path planning in high-dimensional spaces poses significant challenges, particularly in achieving both time efficiency and a fair success rate. To address these issues, we introduce a novel path-planning algorithm, Zonal RL-RRT, that leverages kd-tree partitioning to segment the map into zones while addressing zone connectivity, ensuring seamless transitions between zones. By breaking down the complex environment into multiple zones and using Q-learning as the high-level decision-maker, our algorithm achieves a 3x improvement in time efficiency compared to basic sampling methods such as RRT and RRT* in forest-like maps. Our approach outperforms heuristic-guided methods like BIT* and Informed RRT* by 1.5x in terms of runtime while maintaining robust and reliable success rates across 2D to 6D environments. Compared to learning-based methods like NeuralRRT* and MPNetSMP, as well as the heuristic RRT*J, our algorithm demonstrates, on average, 1.5x better performance in the same environments. We also evaluate the effectiveness of our approach through simulations of the UR10e arm manipulator in the MuJoCo environment. A key observation of our approach lies in its use of zone partitioning and Reinforcement Learning (RL) for adaptive high-level planning allowing the algorithm to accommodate flexible policies across diverse environments, making it a versatile tool for advanced path planning.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。