arXiv:2504.21111cs.RO2025-04被引 6

用深度强化学习协调无人机与地面车,实现高效节能的协同任务规划。

How to Coordinate UAVs and UGVs for Efficient Mission Planning? Optimizing Energy-Constrained Cooperative Routing with a DRL Framework

  • 基于Transformer的DRL框架,动态分配任务并协调充电动作。
  • 相比启发式方法和基线模型,任务完成时间减少30%以上,运行效率显著提升。
  • 适合需要多智能体协同、能源受限的实时任务场景,如搜救与巡检。

协同执行任务的无人机(UAV)与地面机器人(UGV)系统面临能源约束、可扩展性及智能体间协调难题。无人机覆盖范围广但续航短,地面车速度慢但可作为移动充电站。本文提出一种可扩展的深度强化学习(DRL)框架,解决多智能体无人机-地面车团队在能源受限条件下的协同路径规划问题,目标是在最小化任务完成时间的同时,通过地面车为无人机提供中途充电支持。框架采用分轮次智能体切换机制,合理分配任务点并协调行动;利用编码器-解码器变压器架构,优化整体路径与充电会合点。大量计算实验表明,该框架在多种场景下均优于启发式方法与DRL基线,解决方案质量与运行效率显著提升。泛化性测试验证其鲁棒性,动态场景案例展示其对实时变化的适应能力。本工作为多智能体无人机-地面车协同任务规划提供了高效、可靠且可扩展的解决方案。

原文摘要 · Abstract (English)

Efficient mission planning for cooperative systems involving Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) requires addressing energy constraints, scalability, and coordination challenges between agents. UAVs excel in rapidly covering large areas but are constrained by limited battery life, while UGVs, with their extended operational range and capability to serve as mobile recharging stations, are hindered by slower speeds. This heterogeneity makes coordination between UAVs and UGVs critical for achieving optimal mission outcomes. In this work, we propose a scalable deep reinforcement learning (DRL) framework to address the energy-constrained cooperative routing problem for multi-agent UAV-UGV teams, aiming to visit a set of task points in minimal time with UAVs relying on UGVs for recharging during the mission. The framework incorporates sortie-wise agent switching to efficiently manage multiple agents, by allocating task points and coordinating actions. Using an encoder-decoder transformer architecture, it optimizes routes and recharging rendezvous for the UAV-UGV team in the task scenario. Extensive computational experiments demonstrate the framework's superior performance over heuristic methods and a DRL baseline, delivering significant improvements in solution quality and runtime efficiency across diverse scenarios. Generalization studies validate its robustness, while dynamic scenario highlights its adaptability to real-time changes with a case study. This work advances UAV-UGV cooperative routing by providing a scalable, efficient, and robust solution for multi-agent mission planning.

无人机协同强化学习路径规划多智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。