用强化学习实现船舶压载水智能路径规划与堵塞诊断,减少传感器依赖。
RL-Ballast: Ship Ballast Water Path Planning and Clog Prediction via Reinforcement Learning
- 基于图论生成54条可行流路,用强化学习动态规划压载路径。
- 在单个堵塞场景下决策步数从61.0降至41.5,诊断准确率达100%。
- 无需密集传感器,通过历史失败记录定位可疑阀段,适合无人船应用。
在航运4.0背景下,自主化与少人化船舶需具备智能内控系统以保障运行安全与结构稳定。压载水控制对船舶纵倾和结构完整性至关重要,但传统规则或人工方法难以适应阀门故障、管道堵塞等水力异常,且常依赖密集的压力或流量传感器进行诊断。为此,本文提出RL-Ballast,一种基于图的深度强化学习框架,用于自适应压载水路径规划与低传感堵塞候选评分。通过图论与深度优先搜索生成54种可行流路,将阀门组合问题转化为路径选择。部分可观测环境由帧堆叠的舱室液位与动作结果近似,使智能体可推断隐藏堵塞影响,无需显式建模高维部分可观测马尔可夫决策过程(POMDP)。确定性推理中,采用回合级失败动作记忆与动态动作掩码,防止重复无效操作并支持即时重路由。失败转移历史被累积用于排序可疑阀或管段,无需密集仪器。蒙特卡洛模拟显示,RL-Ballast能完成所有意外单堵塞场景,平均决策步数由61.0降至41.5,优于基于Dijkstra的基准方法。诊断方面,在串行不可区分堵塞条件下,失败历史评分方案达到100%的Top-3命中率、66.7%的严格Top-1命中率与83.3%的Top-1平局命中率。结果表明,该方法可在传感受限条件下实现自适应重路由与面向维护的堵塞诊断。
原文摘要 · Abstract (English)
Under the Shipping 4.0 paradigm, autonomous and reduced-crew vessels require intelligent internal systems to maintain operational safety and structural stability. Ballast-water control is essential for ship trim and integrity, but conventional rule-based or manual approaches have limited adaptability to hydraulic anomalies such as valve failures and pipe blockages, and often depend on dense pressure or flow sensors for diagnosis. To address these limitations, this paper proposes RL-Ballast, a graph-based deep reinforcement learning framework for adaptive ballast-water path planning and sensor-frugal blockage candidate scoring. The valve-permutation problem is transformed into 54 feasible fluid-transfer routes generated using graph theory and depth-first search. The partially observable ballast environment is approximated with frame-stacked tank levels and action outcomes, allowing the agent to infer hidden blockage effects without explicitly modeling a high-dimensional POMDP. During deterministic inference, episode-level failed-action memory and dynamic action masking prevent repeated ineffective actions and support immediate rerouting. Failed transfer histories are further accumulated to rank suspicious valves or pipe segments without dense instrumentation. Monte Carlo simulations show that RL-Ballast completes all unexpected single-blockage scenarios and reduces average decision steps from 61.0 to 41.5 compared with a Dijkstra rule-based baseline. For diagnostic support, the failure-history scoring scheme achieves a 100% Top-3 hit rate, a 66.7% strict Top-1 hit rate, and an 83.3% Top-1 tie-hit rate under serially indistinguishable blockage conditions. These results suggest that RL-Ballast enables adaptive rerouting and maintenance-oriented blockage diagnosis under limited sensing conditions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。