arXiv:2409.03930cs.RO2024-09被引 35

单目相机+强化学习,让无人机在室内自主找物并协同搬运。

DRAL: Deep Reinforcement Adaptive Learning for Multi-UAVs Navigation in Unknown Indoor Environment

  • 用深度强化学习模拟专家飞手决策,仅靠单摄像头导航。
  • 多机协同时能自适应调整策略,应对动态环境变化。
  • 适合需要室内自主导航与协作的无人机应用开发。

无人机在室内自主导航面临诸多挑战,主要源于封闭环境中GPS精度有限,且无人机难以携带重型或高功耗传感器。本文提出一种先进系统,使无人机仅依赖单个摄像头,在未知室内环境中自主寻找特定目标(如未知的亚马逊包裹)。通过深度学习方法,训练了一种深度强化自适应学习算法,以生成模仿专家飞行员决策的控制策略。我们在多种室内场景中进行了实时仿真,验证了系统的有效性。同时,采用多种可视化技术深入分析训练后的网络。此外,将方法扩展至多无人机协同场景,实现物体的共同搬运。集成DRAL算法后,多架无人机可学习适应动态条件和不确定性的最优控制策略,显著提升室内导航的鲁棒性与灵活性,为复杂多无人机任务在狭小空间中的应用开辟新路径。该框架在自适应控制与深度强化学习方面取得显著进展,为真实世界多智能体系统提供稳健解决方案。

原文摘要 · Abstract (English)

Autonomous indoor navigation of UAVs presents numerous challenges, primarily due to the limited precision of GPS in enclosed environments. Additionally, UAVs' limited capacity to carry heavy or power-intensive sensors, such as overheight packages, exacerbates the difficulty of achieving autonomous navigation indoors. This paper introduces an advanced system in which a drone autonomously navigates indoor spaces to locate a specific target, such as an unknown Amazon package, using only a single camera. Employing a deep learning approach, a deep reinforcement adaptive learning algorithm is trained to develop a control strategy that emulates the decision-making process of an expert pilot. We demonstrate the efficacy of our system through real-time simulations conducted in various indoor settings. We apply multiple visualization techniques to gain deeper insights into our trained network. Furthermore, we extend our approach to include an adaptive control algorithm for coordinating multiple drones to lift an object in an indoor environment collaboratively. Integrating our DRAL algorithm enables multiple UAVs to learn optimal control strategies that adapt to dynamic conditions and uncertainties. This innovation enhances the robustness and flexibility of indoor navigation and opens new possibilities for complex multi-drone operations in confined spaces. The proposed framework highlights significant advancements in adaptive control and deep reinforcement learning, offering robust solutions for complex multi-agent systems in real-world applications.

无人机导航强化学习多机协同

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。