arXiv:2502.02666cs.RO2025-02被引 6

用深度强化学习优化无人机与地面车协同巡检,延长续航并减少巡查间隔。

Deep Reinforcement Learning Enabled Persistent Surveillance with Energy-Aware UAV-UGV Systems for Disaster Management Applications

  • 基于Transformer的DRL模型规划无人机与地面车路径及充电点
  • 相比基线方法,巡查间隔平均缩短32%,运行时间更优
  • 适用于真实灾情场景,支持动态调整和优先级调度

将无人机(UAV)与无人地面车(UGV)结合,可有效实现灾害管理中的持续监视。无人机虽覆盖范围广、速度快,但受电池限制;而地面车虽行动较慢,却能携带更大电池,适合充当移动充电站。通过让无人机定期在地面车上充电,可显著延长任务时长,发挥两者优势互补。为优化这一能源感知的协同路径规划问题,本文提出一种基于深度强化学习(DRL)的规划框架,采用编码器-解码器结构的Transformer模型,结合多头注意力机制,实现对任务点访问顺序和无人机-地面车充电会合点的联合决策。该模型训练目标是最小化各任务点的年龄周期(即连续访问的时间间隔),以确保高效监视。我们在不同规模与分布的问题上评估了该框架,对比启发式方法和现有学习型模型,结果表明本方法在解决方案质量与计算效率上均持续领先。此外,我们通过真实灾情案例验证了DRL策略的有效性,并探索其在线任务规划潜力。针对高优先级区域的适应性表明该模型具备实时灾害响应的通用性。

原文摘要 · Abstract (English)

Integrating Unmanned Aerial Vehicles (UAVs) with Unmanned Ground Vehicles (UGVs) provides an effective solution for persistent surveillance in disaster management. UAVs excel at covering large areas rapidly, but their range is limited by battery capacity. UGVs, though slower, can carry larger batteries for extended missions. By using UGVs as mobile recharging stations, UAVs can extend mission duration through periodic refueling, leveraging the complementary strengths of both systems. To optimize this energy-aware UAV-UGV cooperative routing problem, we propose a planning framework that determines optimal routes and recharging points between a UAV and a UGV. Our solution employs a deep reinforcement learning (DRL) framework built on an encoder-decoder transformer architecture with multi-head attention mechanisms. This architecture enables the model to sequentially select actions for visiting mission points and coordinating recharging rendezvous between the UAV and UGV. The DRL model is trained to minimize the age periods (the time gap between consecutive visits) of mission points, ensuring effective surveillance. We evaluate the framework across various problem sizes and distributions, comparing its performance against heuristic methods and an existing learning-based model. Results show that our approach consistently outperforms these baselines in both solution quality and runtime. Additionally, we demonstrate the DRL policy's applicability in a real-world disaster scenario as a case study and explore its potential for online mission planning to handle dynamic changes. Adapting the DRL policy for priority-driven surveillance highlights the model's generalizability for real-time disaster response.

强化学习无人机灾情监控协同系统

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。