构建首个船坞船舶多模态对齐数据集,支持长期海洋监测与分析。
SMART-Ship: A Comprehensive Synchronized Multi-modal Aligned Remote Sensing Targets Dataset and Benchmark for Berthed Ships Analysis
- 五模态数据同步采集,时空对齐并精细标注。
- 覆盖38,838艘船,每组图像一周内获取且配准。
- 适合遥感、目标检测与跨模态学习研究者使用。
由于卫星轨道和成像条件的限制,多模态遥感(RS)数据在实现长期地球观测中至关重要。然而,由于目标尺度复杂且环境动态变化,海上监视仍具挑战性。为填补这一关键空白,我们提出面向停泊船舶分析的同步多模态对齐遥感目标数据集SMART-Ship,包含五个模态的时空注册图像:可见光、合成孔径雷达(SAR)、全色、多光谱和近红外。数据集共包含1092组多模态图像,覆盖38,838艘船舶。每组图像在一周内采集并严格配准,确保时空一致性。每组图像中,船舶实例标注了多边形位置、细粒度类别、实例级标识符及变化区域掩码,分层组织以支持多样化的多模态遥感任务。此外,我们在五个基础任务上定义了标准化基准,并全面比较了代表性方法。实验验证表明,SMART-Ship可有效支持多种多模态遥感解析任务,揭示了未来探索的潜力方向。
原文摘要 · Abstract (English)
Given the limitations of satellite orbits and imaging conditions, multi-modal remote sensing (RS) data is crucial in enabling long-term earth observation. However, maritime surveillance remains challenging due to the complexity of multi-scale targets and the dynamic environments. To bridge this critical gap, we propose a Synchronized Multi-modal Aligned Remote sensing Targets dataset for berthed ships analysis (SMART-Ship), containing spatiotemporal registered images with fine-grained annotation for maritime targets from five modalities: visible-light, synthetic aperture radar (SAR), panchromatic, multi-spectral, and near-infrared. Specifically, our dataset consists of 1092 multi-modal image sets, covering 38,838 ships. Each image set is acquired within one week and registered to ensure spatiotemporal consistency. Ship instances in each set are annotated with polygonal location information, fine-grained categories, instance-level identifiers, and change region masks, organized hierarchically to support diverse multi-modal RS tasks. Furthermore, we define standardized benchmarks on five fundamental tasks and comprehensively compare representative methods across the dataset. Thorough experiment evaluations validate that the proposed SMART-Ship dataset could support various multi-modal RS interpretation tasks and reveal the promising directions for further exploration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。