arXiv:2501.10141cs.LGcs.AI2025-01中稿 · https://camad2024被引 2

用降维与优化算法,让无人机通信路径规划快四倍。

Enhancing UAV Path Planning Efficiency Through Accelerated Learning

  • 结合PCA降维与优先经验回放,压缩训练数据
  • 使TD3算法收敛所需迭代次数减少约75%
  • 适合需要快速部署的无人机通信系统

无人飞行器(UAV)在监控、侦察和通信等领域日益重要。本文针对无人机无线通信中继的路径规划问题,提出一种加速深度强化学习(DRL)收敛的算法。基于地形图和用户位置估计,传统方法需高分辨率地图以提取高程、障碍物距离和信号遮挡等拓扑信息,导致存储需求大、收敛慢。本研究通过主成分分析(PCA)降维、样本组合、优先经验回放(PER)及均方误差(MSE)与平均绝对误差(MAE)混合损失函数,优化覆盖地图估计,改进孪生延迟深度确定性策略梯度(TD3)算法。实验表明,该方法将基本训练所需的收敛迭代次数减少约四倍,显著提升路径规划效率。

原文摘要 · Abstract (English)

Unmanned Aerial Vehicles (UAVs) are increasingly essential in various fields such as surveillance, reconnaissance, and telecommunications. This study aims to develop a learning algorithm for the path planning of UAV wireless communication relays, which can reduce storage requirements and accelerate Deep Reinforcement Learning (DRL) convergence. Assuming the system possesses terrain maps of the area and can estimate user locations using localization algorithms or direct GPS reporting, it can input these parameters into the learning algorithms to achieve optimized path planning performance. However, higher resolution terrain maps are necessary to extract topological information such as terrain height, object distances, and signal blockages. This requirement increases memory and storage demands on UAVs while also lengthening convergence times in DRL algorithms. Similarly, defining the telecommunication coverage map in UAV wireless communication relays using these terrain maps and user position estimations demands higher memory and storage utilization for the learning path planning algorithms. Our approach reduces path planning training time by applying a dimensionality reduction technique based on Principal Component Analysis (PCA), sample combination, Prioritized Experience Replay (PER), and the combination of Mean Squared Error (MSE) and Mean Absolute Error (MAE) loss calculations in the coverage map estimates, thereby enhancing a Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm. The proposed solution reduces the convergence episodes needed for basic training by approximately four times compared to the traditional TD3.

无人机路径规划强化学习降维TD3

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。