用自监督方法从少量标注数据中发现海洋声学信号模式。
A Self-Supervised Approach for Minimal-Annotation Hydroacoustic Data Exploration

- 用掩码自编码器预训练,提取频谱图块级特征
- 317个聚类结果在1小时内对应到15类声学信号
- 适合稀有信号探索,尤其适用于标注成本高的场景
被动水声监测常产生大量连续录音,但因人工标注成本高,仅部分被利用。监督检测方法虽有效,却需大规模标注数据,而稀有信号或未充分研究环境的数据往往难以获取。本文提出一种自监督探索流程,针对低频场景。通过掩码自编码器(MAE)在重构任务上预训练,提取频谱图的块级表示;相邻信息块聚合为事件级嵌入,实现重叠事件解耦。随后采用UMAP降维与HDBSCAN聚类,在马约特岛印度洋海域多年水声数据集上识别声学模式,该数据包含海洋哺乳动物叫声、地震火山信号及人为噪声。317个聚类在不足一小时内被人工映射至15类声学信号或噪声。评估显示:作为分类器时性能可比现有两种探测器;定性上恢复了已知海洋哺乳动物声活动的季节性规律,并发现了此前未研究信号模式,证明其实际价值。
原文摘要 · Abstract (English)
Passive hydroacoustic monitoring often generates large volumes of continuous recordings that are only partially exploited due to the cost of manual annotation. Supervised detection methods perform well but require large labeled datasets, seldom available for rare signals or understudied environments. This work proposes a self-supervised exploration pipeline to address this limitation in low-frequency settings. A Masked AutoEncoder (MAE) is pre-trained on a reconstruction pretext task, then used to extract patch-level representations from spectrograms. Within each spectrogram, adjacent informative patches are aggregated into event-level embeddings, enabling the disentanglement of overlapping events. These embeddings are then clustered at the dataset scale using the dimension reduction algorithm UMAP and the clustering algorithm HDBSCAN to identify hydroacoustic patterns. The pipeline was applied to a multi-year hydroacoustic dataset collected near Mayotte Island, Indian Ocean, containing marine mammal vocalizations, seismo-volcanic signals, and anthropogenic noise. The 317 clusters were manually mapped to 15 hydroacoustic classes or noise in less than one hour. The method was evaluated in two ways. Quantitatively, when used as a classifier, it achieved performance comparable to two existing detectors. Qualitatively, it recovered known seasonal patterns of marine mammal acoustic activity. It also identified patterns of previously unstudied signals, thereby demonstrating its practical value.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。