arXiv:2410.04946cs.CVcs.AI2024-10被引 2

用深度学习实现实时船舶识别与定位,提升海上态势感知能力。

Real-time Ship Recognition and Georeferencing for the Improvement of Maritime Situational Awareness

  • 设计轻量级模型ScatYOLOv8+CBAM,在嵌入式设备上实现毫秒级推理
  • 在自建数据集ShipSG上达75.46% mAP,小远船识别性能提升8%-11%
  • 定位误差仅18米(400米内),适合海上监控与智能决策场景

在海事基础设施日益重要的背景下,实时态势感知愈发关键。本文利用光学相机系统实现海上视频的实时处理,提出基于深度学习与计算机视觉的实时船舶识别与地理定位方法。构建了包含3,505张图像和11,625个船体标注的ShipSG数据集,涵盖类别与地理坐标。针对嵌入式平台,设计了轻量级分割模型ScatYOLOv8+CBAM,融合二维散射变换与注意力机制,在NVIDIA Jetson AGX Xavier上实现每帧25.3毫秒的推理速度,mAP达75.46%,优于现有方法超5%。为提升高分辨率图像中远距离小船检测效果,引入增强切片策略,使mAP提升8%至11%。同时提出地理定位方法,在400米内误差仅18米,400-1200米区间为44米。研究成果已应用于异常行为检测、相机状态评估与三维重建等实际场景。该框架有效整合识别与定位结果,推动实时海事监控发展,为船舶分割与定位研究建立了基准。

原文摘要 · Abstract (English)

In an era where maritime infrastructures are crucial, advanced situational awareness solutions are increasingly important. The use of optical camera systems can allow real-time usage of maritime footage. This thesis presents an investigation into leveraging deep learning and computer vision to advance real-time ship recognition and georeferencing for the improvement of maritime situational awareness. A novel dataset, ShipSG, is introduced, containing 3,505 images and 11,625 ship masks with corresponding class and geographic position. After an exploration of state-of-the-art, a custom real-time segmentation architecture, ScatYOLOv8+CBAM, is designed for the NVIDIA Jetson AGX Xavier embedded system. This architecture adds the 2D scattering transform and attention mechanisms to YOLOv8, achieving an mAP of 75.46% and an 25.3 ms per frame, outperforming state-of-the-art methods by over 5%. To improve small and distant ship recognition in high-resolution images on embedded systems, an enhanced slicing mechanism is introduced, improving mAP by 8% to 11%. Additionally, a georeferencing method is proposed, achieving positioning errors of 18 m for ships up to 400 m away and 44 m for ships between 400 m and 1200 m. The findings are also applied in real-world scenarios, such as the detection of abnormal ship behaviour, camera integrity assessment and 3D reconstruction. The approach of this thesis outperforms existing methods and provides a framework for integrating recognized and georeferenced ships into real-time systems, enhancing operational effectiveness and decision-making for maritime stakeholders. This thesis contributes to the maritime computer vision field by establishing a benchmark for ship segmentation and georeferencing research, demonstrating the viability of deep-learning-based recognition and georeferencing methods for real-time maritime monitoring.

船舶识别实时检测地理定位嵌入式视觉

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。