百万级声学图像数据集,助力海底栖息地自动分类
BenthiCat: An opti-acoustic dataset for advancing benthic classification and habitat mapping
- 构建西班牙加泰罗尼亚海岸百万级侧扫声呐图块数据集
- 3.6万张图块含分割标注,支持监督训练与模型评估
- 融合光学影像与地形数据,适合水下探测与多模态学习研究
海底栖息地制图对理解海洋生态系统、指导保护工作和支撑可持续资源管理至关重要。然而,大规模标注数据集的缺乏限制了该领域机器学习模型的发展与基准测试。本文提出一个全面的多模态数据集,包含约一百万个沿加泰罗尼亚海岸采集的侧扫声呐(SSS)图块,配套高程地图及使用自主水下航行器(AUV)获取的共注册光学影像。约36,000个SSS图块已通过人工标注生成分割掩码,支持分类模型的监督微调。所有原始传感器数据及拼接图均已发布,以支持进一步探索与算法开发。为解决AUV多传感器融合挑战,将光学影像与对应SSS图块空间对齐,促进自监督跨模态表示学习。配套开源预处理与标注工具提升可访问性,推动研究。该资源旨在建立水下栖息地制图的标准基准,促进自主海床分类与多传感器集成技术的进步。
原文摘要 · Abstract (English)
Benthic habitat mapping is fundamental for understanding marine ecosystems, guiding conservation efforts, and supporting sustainable resource management. Yet, the scarcity of large, annotated datasets limits the development and benchmarking of machine learning models in this domain. This paper introduces a thorough multi-modal dataset, comprising about a million side-scan sonar (SSS) tiles collected along the coast of Catalonia (Spain), complemented by bathymetric maps and a set of co-registered optical images from targeted surveys using an autonomous underwater vehicle (AUV). Approximately 36000 of the SSS tiles have been manually annotated with segmentation masks to enable supervised fine-tuning of classification models. All the raw sensor data, together with mosaics, are also released to support further exploration and algorithm development. To address challenges in multi-sensor data fusion for AUVs, we spatially associate optical images with corresponding SSS tiles, facilitating self-supervised, cross-modal representation learning. Accompanying open-source preprocessing and annotation tools are provided to enhance accessibility and encourage research. This resource aims to establish a standardized benchmark for underwater habitat mapping, promoting advancements in autonomous seafloor classification and multi-sensor integration.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。