用强化学习加路径规划,解决多机器人导航死锁问题。
Deadlock-Free Hybrid RL-MAPF Framework for Zero-Shot Multi-Robot Navigation
- 结合强化学习与路径规划,动态检测并化解死锁
- 在密集环境中任务完成率从低提升至接近100%
- 适合需要零样本泛化的异构机器人协同场景
在复杂环境中进行多机器人导航时,需在反应式避障与远距离目标达成之间取得平衡。当通过狭窄通道或受限空间时,常因拓扑结构导致死锁,尤其在强化学习控制策略遭遇未见环境配置时更为严重。现有基于强化学习的方法在未知环境中的泛化能力有限。本文提出一种混合框架,将基于强化学习的反应式导航与按需调用的多智能体路径规划(MAPF)无缝集成,以显式解决拓扑死锁。该方法引入安全层监控代理进展,一旦检测到死锁即触发协调控制器,通过MAPF生成全局可行轨迹,并调控航点推进以减少代理间冲突。在密集多智能体基准测试中,任务完成率从低水平跃升至近乎完全成功,显著降低死锁与碰撞。结合分层任务规划后,可实现异构机器人的协同导航,证明将反应式强化学习与选择性地图规划结合,可获得鲁棒的零样本性能。
原文摘要 · Abstract (English)
Multi-robot navigation in cluttered environments presents fundamental challenges in balancing reactive collision avoidance with long-range goal achievement. When navigating through narrow passages or confined spaces, deadlocks frequently emerge that prevent agents from reaching their destinations, particularly when Reinforcement Learning (RL) control policies encounter novel configurations out of learning distribution. Existing RL-based approaches suffer from limited generalization capability in unseen environments. We propose a hybrid framework that seamlessly integrates RL-based reactive navigation with on-demand Multi-Agent Path Finding (MAPF) to explicitly resolve topological deadlocks. Our approach integrates a safety layer that monitors agent progress to detect deadlocks and, when detected, triggers a coordination controller for affected agents. The framework constructs globally feasible trajectories via MAPF and regulates waypoint progression to reduce inter-agent conflicts during navigation. Extensive evaluation on dense multi-agent benchmarks shows that our method boosts task completion from marginal to near-universal success, markedly reducing deadlocks and collisions. When integrated with hierarchical task planning, it enables coordinated navigation for heterogeneous robots, demonstrating that coupling reactive RL navigation with selective MAPF intervention yields a robust, zero-shot performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。