arXiv:2504.10974cs.CVeess.IV2025-04被引 3

自监督增强声呐图像,解决跨模态退化问题,提升目标检测能力

Self-Supervised Enhancement of Forward-Looking Sonar Images: Bridging Cross-Modal Degradation Gaps through Feature Space Transformation and Multi-Frame Fusion

  • 通过特征空间变换将声呐图从像素域转到鲁棒特征域
  • 多帧融合有效抑制斑点噪声,提升目标区域亮度
  • 在3个真实数据集上表现优于现有方法,适合水下探测应用

增强前视声呐图像对水下目标检测至关重要。当前深度学习方法主要依赖模拟数据的有监督训练,但高质量真实配对数据难以获取,限制了其实际应用与泛化能力。尽管遥感领域的自监督方法部分缓解了数据不足问题,却忽视了声呐与遥感图像间的跨模态退化差异。直接迁移预训练权重常导致声呐图像过平滑、细节丢失和亮度不足。为此,本文提出一种特征空间变换,将声呐图像从像素域映射至鲁棒特征域,有效弥合退化差距。同时,设计自监督多帧融合策略,利用帧间互补信息自然去除斑点噪声并增强目标区域亮度。在三个自收集的真实声呐数据集上的实验表明,该方法显著优于现有方法,有效抑制噪声、保持边缘细节并大幅改善亮度,展现出在水下目标检测中的强大潜力。

原文摘要 · Abstract (English)

Enhancing forward-looking sonar images is critical for accurate underwater target detection. Current deep learning methods mainly rely on supervised training with simulated data, but the difficulty in obtaining high-quality real-world paired data limits their practical use and generalization. Although self-supervised approaches from remote sensing partially alleviate data shortages, they neglect the cross-modal degradation gap between sonar and remote sensing images. Directly transferring pretrained weights often leads to overly smooth sonar images, detail loss, and insufficient brightness. To address this, we propose a feature-space transformation that maps sonar images from the pixel domain to a robust feature domain, effectively bridging the degradation gap. Additionally, our self-supervised multi-frame fusion strategy leverages complementary inter-frame information to naturally remove speckle noise and enhance target-region brightness. Experiments on three self-collected real-world forward-looking sonar datasets show that our method significantly outperforms existing approaches, effectively suppressing noise, preserving detailed edges, and substantially improving brightness, demonstrating strong potential for underwater target detection applications.

声呐增强自监督学习多帧融合水下检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。