针对声呐图像数据稀缺,提出首个领域自监督学习方法,提升水下目标识别性能。
Mine-JEPA: In-Domain Self-Supervised Learning for Mine-Like Object Classification in Side-Scan Sonar
- 基于正则化损失设计声呐领域自监督预训练,仅用1170张无标签图像
- 二分类F1达0.935,三分类准确率0.820,超越大模型DINOv3
- 小模型轻量高效,参数量仅为DINOv3的1/4,适合资源受限场景
侧扫声呐(SSS)水雷分类是海洋视觉中极具挑战性的问题,其特征为数据极度稀缺且与自然图像存在显著域差距。尽管自监督学习(SSL)和通用视觉基础模型在通用视觉及其他特定领域表现优异,但其在声呐领域的应用仍基本未被探索。本文提出Mine-JEPA,首个面向声呐水雷分类的领域内自监督学习流程,采用SIGReg正则化损失,在仅1,170张无标签声呐图像上进行预训练。在二分类(水雷 vs 非水雷)任务中,Mine-JEPA达到0.935的F1分数,优于微调后的DINOv3(0.922),后者基于17亿张图像预训练。在三类水雷类物体分类中,结合合成数据增强后,Mine-JEPA达到0.820,仍优于微调后的DINOv3(0.810)。此外,将领域自监督应用于大模型反而导致性能下降10–13个百分点,表明更强预训练模型未必受益于额外域适配。使用紧凑的ViT-Tiny骨干网络的Mine-JEPA,性能媲美大模型,但参数量仅为DINOv3的1/4。结果表明,在数据稀缺的海洋声呐图像中,精心设计的领域自监督学习是比大型基础模型更可行的替代方案。
原文摘要 · Abstract (English)
Side-scan sonar (SSS) mine classification is a challenging maritime vision problem characterized by extreme data scarcity and a large domain gap from natural images. While self-supervised learning (SSL) and general-purpose vision foundation models have shown strong performance in general vision and several specialized domains, their use in SSS remains largely unexplored. We present Mine-JEPA, the first in-domain SSL pipeline for SSS mine classification, using SIGReg, a regularization-based SSL loss, to pretrain on only 1,170 unlabeled sonar images. In the binary mine vs. non-mine setting, Mine-JEPA achieves an F1 score of 0.935, outperforming fine-tuned DINOv3 (0.922), a foundation model pretrained on 1.7B images. For 3-class mine-like object classification, Mine-JEPA reaches 0.820 with synthetic data augmentation, again outperforming fine-tuned DINOv3 (0.810). We further observe that applying in-domain SSL to foundation models degrades performance by 10--13 percentage points, suggesting that stronger pretrained models do not always benefit from additional domain adaptation. In addition, Mine-JEPA with a compact ViT-Tiny backbone achieves competitive performance while using 4x fewer parameters than DINOv3. These results suggest that carefully designed in-domain self-supervised learning is a viable alternative to much larger foundation models in data-scarce maritime sonar imagery.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。