融合AIS与CCTV数据,用图学习提升海上多船关联精度。
Graph Learning-Driven Multi-Vessel Association: Fusing Multimodal Data for Maritime Intelligence
- 基于图神经网络和时序注意力,建模船舶时空轨迹关系。
- 在高密度场景下关联准确率超越现有方法,支持不完整数据。
- 适合海上交通监控、智能航运系统研发人员使用。
保障日益拥挤复杂的水道航行安全与优化交通管理需高效水域监测。当前方法面临多源数据挑战,如维度差异、目标数量不匹配、船体尺度变化、遮挡及自动识别系统(AIS)与闭路电视(CCTV)数据流异步等问题。传统多目标关联方法难以应对密集水域复杂情况。为此,提出面向海事多模态数据融合的图学习驱动多船关联(GMvA)方法。通过融合AIS与CCTV数据,GMvA结合时序学习与图神经网络,有效捕捉船舶轨迹的时空特征。为增强特征表示,引入时间图注意力与时空注意力机制,充分建模局部与全局船舶交互。此外,采用基于多层感知机的不确定性融合模块计算鲁棒相似度分数,并以匈牙利算法实现全局一致且精准的目标匹配。在真实海事数据集上的大量实验表明,GMvA在多目标关联中表现卓越,即使在高密度、数据不完整或分布不均情况下仍显著优于现有方法。
原文摘要 · Abstract (English)
Ensuring maritime safety and optimizing traffic management in increasingly crowded and complex waterways require effective waterway monitoring. However, current methods struggle with challenges arising from multimodal data, such as dimensional disparities, mismatched target counts, vessel scale variations, occlusions, and asynchronous data streams from systems like the automatic identification system (AIS) and closed-circuit television (CCTV). Traditional multi-target association methods often struggle with these complexities, particularly in densely trafficked waterways. To overcome these issues, we propose a graph learning-driven multi-vessel association (GMvA) method tailored for maritime multimodal data fusion. By integrating AIS and CCTV data, GMvA leverages time series learning and graph neural networks to capture the spatiotemporal features of vessel trajectories effectively. To enhance feature representation, the proposed method incorporates temporal graph attention and spatiotemporal attention, effectively capturing both local and global vessel interactions. Furthermore, a multi-layer perceptron-based uncertainty fusion module computes robust similarity scores, and the Hungarian algorithm is adopted to ensure globally consistent and accurate target matching. Extensive experiments on real-world maritime datasets confirm that GMvA delivers superior accuracy and robustness in multi-target association, outperforming existing methods even in challenging scenarios with high vessel density and incomplete or unevenly distributed AIS and CCTV data.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。