用深度强化学习优化农业无人机路径规划,动态避障成功率95%。
Optimizing Path Planning using Deep Reinforcement Learning for UGVs in Precision Agriculture
- 采用连续动作空间的TD3算法,实现复杂农田环境下的自适应路径决策。
- 在动态环境中路径规划成功率达95%,优于传统网格搜索方法。
- 适合研究智能农机自主导航或强化学习应用的科研人员参考。
本研究针对精准农业中无人地面车辆(UGVs)的路径规划问题,采用深度强化学习(DRL)技术,在连续动作空间下进行优化。首先回顾了A*、Dijkstra等传统网格化方法在动态农业环境中的局限性,强调需引入自适应学习策略。随后对比了Deep Q-Network(DQN)、Double DQN与Dueling DQN等模型在二维仿真中的表现,验证其改进的决策能力。进一步转向连续动作空间模型,测试Deep Deterministic Policy Gradient(DDPG)与Twin Delayed Deep Deterministic Policy Gradient(TD3)在逐步复杂的环境中的性能。基于ROS与Gazebo构建的三维仿真平台实验表明,预训练的TD3代理在动态环境中达到95%的成功率,有效应对移动障碍物,保障作物与机器人安全,展现出该方法在动态农业场景下的鲁棒性。
原文摘要 · Abstract (English)
This study focuses on optimizing path planning for unmanned ground vehicles (UGVs) in precision agriculture using deep reinforcement learning (DRL) techniques in continuous action spaces. The research begins with a review of traditional grid-based methods, such as A* and Dijkstra's algorithms, and discusses their limitations in dynamic agricultural environments, highlighting the need for adaptive learning strategies. The study then explores DRL approaches, including Deep Q-Networks (DQN), which demonstrate improved adaptability and performance in two-dimensional simulations. Enhancements such as Double Q-Networks and Dueling Networks are evaluated to further improve decision-making. Building on these results, the focus shifts to continuous action space models, specifically Deep Deterministic Policy Gradient (DDPG) and Twin Delayed Deep Deterministic Policy Gradient (TD3), which are tested in increasingly complex environments. Experiments conducted in a three-dimensional environment using ROS and Gazebo demonstrate the effectiveness of continuous DRL algorithms in navigating dynamic agricultural scenarios. Notably, the pretrained TD3 agent achieves a 95 percent success rate in dynamic environments, demonstrating the robustness of the proposed approach in handling moving obstacles while ensuring safety for both crops and the robot.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。