arXiv:2409.04730cs.RO2024-09被引 17

让机器人团队在断断续续连网下高效探索,减少无效往返。

IR2: Implicit Rendezvous for Robotic Exploration Teams under Sparse Intermittent Connectivity

  • 用强化学习让机器人权衡独自探索与汇合共享信息的长期收益。
  • 相比现有方法,探索路径缩短6.6%至34.1%,且支持大规模环境。
  • 适合需要低通信依赖的机器人协同任务,如搜救或巡检。

在大场景中,小型机器人团队进行实时探索时,信息共享至关重要,但常面临稀疏且间歇性连接的挑战。现有方法多假设理想全局连通性,或依赖近距离/可视通信,效率低下:预规划汇合会产生不必要的绕行,而追踪式方法因贪婪决策导致短视。本文提出IR2,一种基于注意力神经网络的深度强化学习框架,通过课程学习训练,使机器人能有效权衡断开连接独立探索与重新汇合共享信息的长期代价。我们还设计了一种分层图结构,保持稀疏但信息丰富的通信图,实现大规模环境下的可扩展性。在三个Gazebo大型仿真环境中验证,相较于最先进基线,探索路径缩短6.6%-34.1%;最后将训练好的策略部署到真实硬件平台。代码已开源于https://ir2-explore.github.io。

原文摘要 · Abstract (English)

Information sharing is critical in time-sensitive and realistic multi-robot exploration, especially for smaller robotic teams in large-scale environments where connectivity may be sparse and intermittent. Existing methods often overlook such communication constraints by assuming unrealistic global connectivity. Other works account for communication constraints (by maintaining close proximity or line of sight during information exchange), but are often inefficient. For instance, preplanned rendezvous approaches typically involve unnecessary detours resulting from poorly timed rendezvous, while pursuit-based approaches often result in short-sighted decisions due to their greedy nature. We present IR2, a deep reinforcement learning approach to information sharing for multi-robot exploration. Leveraging attention-based neural networks trained via reinforcement and curriculum learning, IR2 allows robots to effectively reason about the longer-term trade-offs between disconnecting for solo exploration and reconnecting for information sharing. In addition, we propose a hierarchical graph formulation to maintain a sparse yet informative graph, enabling our approach to scale to large-scale environments. We present simulation results in three large-scale Gazebo environments, which show that our approach yields 6.6-34.1% shorter exploration paths when compared to state-of-the-art baselines, and lastly deploy our learned policy on hardware. Our simulation training and testing code is available at https://ir2-explore.github.io.

多机器人强化学习路径优化稀疏通信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。