arXiv:2603.28385cs.LGcs.AI2026-03

用AI自动生成海上巡检路径,比传统方法快一倍且更省油。

Critic-Free Deep Reinforcement Learning for Maritime Coverage Path Planning on Irregular Hexagonal Grids

  • 用Transformer模型一步步生成巡检路线,不依赖传统分解方法。
  • 在1000个新海域测试中,成功率达99.1%,路径比最优启发式短7%。
  • 无需价值函数评估,适合嵌入船载系统实时运行。

海上监视任务如搜救和环境监测,需在广阔且几何复杂的区域高效部署传感设备。传统覆盖路径规划(CPP)依赖分解技术,难以处理不规则海岸线、岛屿和禁飞区,或需对每个实例进行计算昂贵的重规划。本文提出一种基于深度强化学习(DRL)的框架,在不规则海区的六边形网格上求解CPP。不同于传统方法,将问题建模为神经组合优化任务,采用Transformer-based指针策略自回归构建覆盖路径。为克服长时序路径问题中价值估计不稳定的难题,提出无评判器的组内相对策略优化(GRPO)方案,通过实例内轨迹采样比较来估计优势,而非依赖价值函数。在1000个未见的合成海区环境中实验表明,训练好的策略达到99.1%的哈密顿成功率,超过最佳启发式方法(46.0%)两倍以上,路径长度缩短7%,转向次数减少最多达24.1%。所有三种推理模式(贪婪、随机采样、带2-opt优化的采样)均在笔记本GPU上每实例耗时低于50毫秒,证实其适用于实时船上部署。

原文摘要 · Abstract (English)

Maritime surveillance missions, such as search and rescue and environmental monitoring, rely on the efficient allocation of sensing assets over vast and geometrically complex areas. Traditional Coverage Path Planning (CPP) approaches depend on decomposition techniques that struggle with irregular coastlines, islands, and exclusion zones, or require computationally expensive re-planning for every instance. We propose a Deep Reinforcement Learning (DRL) framework to solve CPP on hexagonal grid representations of irregular maritime areas. Unlike conventional methods, we formulate the problem as a neural combinatorial optimization task where a Transformer-based pointer policy autoregressively constructs coverage tours. To overcome the instability of value estimation in long-horizon routing problems, we implement a critic-free Group-Relative Policy Optimization (GRPO) scheme. This method estimates advantages through within-instance comparisons of sampled trajectories rather than relying on a value function. Experiments on 1,000 unseen synthetic maritime environments demonstrate that a trained policy achieves a 99.1% Hamiltonian success rate, more than double the best heuristic (46.0%), while producing paths 7% shorter and up to 24.1% fewer heading changes than the closest heuristic baseline. All three inference modes (greedy, stochastic sampling, and sampling with 2-opt refinement) operate under 50 ms per instance on a laptop GPU, confirming feasibility for real-time onboard deployment.

路径规划强化学习海上巡检六边形网格

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。