arXiv:2510.11449cs.CV2025-10

用卫星+AIS融合识别内河暗船,提升航运监控能力

Enhancing Maritime Domain Awareness on Inland Waterways: A YOLO-Based Fusion of Satellite and AIS for Vessel Characterization

  • 用YOLOv11融合卫星图像与AIS数据,自动识别船型和状态
  • 船型分类F1达95.8%,暗船检测准确率超98%
  • 适合交通监管、安全巡查和智能航运系统开发者

内河海域态势感知(MDA)面临合作系统易受干扰的挑战。本文提出一种新框架,融合高分辨率卫星影像与船舶自动识别系统(AIS)轨迹数据,通过非合作的卫星视觉信息弥补AIS局限,实现对暗船识别、交通验证和高级态势感知支持。采用YOLOv11模型对船只类型、驳船覆盖状态、运行状态、驳船数量及航行方向进行检测与分类。基于密西西比河下游5,973平方英里影像构建了包含4,550个标注实例的数据集。在独立测试集上,船型分类F1得分为95.8%;驳船覆盖状态检测F1为91.6%;运行状态(待命或移动)分类达到99.4%;航行方向识别准确率达93.8%;驳船数量估计均方绝对误差(MAE)为2.4艘。跨地理区域的空间可迁移性分析显示,准确率仍维持在98%。结果证明,结合非合作卫星感知与AIS融合具有可行性,可实现近实时船队清点、异常检测,并生成高质量内河监视数据。未来将扩展标注数据集,引入时序追踪,探索多模态深度学习以提升运营可扩展性。

原文摘要 · Abstract (English)

Maritime Domain Awareness (MDA) for inland waterways remains challenged by cooperative system vulnerabilities. This paper presents a novel framework that fuses high-resolution satellite imagery with vessel trajectory data from the Automatic Identification System (AIS). This work addresses the limitations of AIS-based monitoring by leveraging non-cooperative satellite imagery and implementing a fusion approach that links visual detections with AIS data to identify dark vessels, validate cooperative traffic, and support advanced MDA. The You Only Look Once (YOLO) v11 object detection model is used to detect and characterize vessels and barges by vessel type, barge cover, operational status, barge count, and direction of travel. An annotated data set of 4,550 instances was developed from $5{,}973~\mathrm{mi}^2$ of Lower Mississippi River imagery. Evaluation on a held-out test set demonstrated vessel classification (tugboat, crane barge, bulk carrier, cargo ship, and hopper barge) with an F1 score of 95.8\%; barge cover (covered or uncovered) detection yielded an F1 score of 91.6\%; operational status (staged or in motion) classification reached an F1 score of 99.4\%. Directionality (upstream, downstream) yielded 93.8\% accuracy. The barge count estimation resulted in a mean absolute error (MAE) of 2.4 barges. Spatial transferability analysis across geographically disjoint river segments showed accuracy was maintained as high as 98\%. These results underscore the viability of integrating non-cooperative satellite sensing with AIS fusion. This approach enables near-real-time fleet inventories, supports anomaly detection, and generates high-quality data for inland waterway surveillance. Future work will expand annotated datasets, incorporate temporal tracking, and explore multi-modal deep learning to further enhance operational scalability.

目标检测卫星遥感AIS融合内河监控

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。