首个水下伪装实例分割数据集与模型,提升海洋生物识别精度。
Expose Camouflage in the Water: Underwater Camouflaged Instance Segmentation and Dataset
- 基于SAM改进网络,引入三模块增强水下特征学习。
- 在UCIS4K数据集上达到83.2%的mAP,优于现有方法。
- 适合水下生态监测、海洋保护研究者使用。
随着水下探索与海洋保护的发展,水下视觉任务日益普及。由于水下环境存在色彩失真、对比度低、模糊等问题,伪装实例分割(CIS)在识别与背景高度融合的物体时面临更大挑战。传统伪装实例分割方法多在陆地主导的数据集上训练,水下样本有限,性能不足。为此,我们提出首个水下伪装实例分割数据集UCIS4K,包含3,953张带有实例级标注的水下伪装生物图像。同时,我们构建了基于通用分割模型(SAM)的水下伪装实例分割网络UCIS-SAM。该模型包含三个核心模块:通道平衡优化模块(CBOM)提升通道表征能力,增强水下特征学习;频域真实融合模块(FDTIM)强化物体本质特征,抑制伪装图案干扰;多尺度特征频域聚合模块(MFFAM)在多频带增强低对比度伪装实例边界。在自建的UCIS4K及公开基准上的大量实验表明,所提方法显著优于现有先进模型。
原文摘要 · Abstract (English)
With the development of underwater exploration and marine protection, underwater vision tasks are widespread. Due to the degraded underwater environment, characterized by color distortion, low contrast, and blurring, camouflaged instance segmentation (CIS) faces greater challenges in accurately segmenting objects that blend closely with their surroundings. Traditional camouflaged instance segmentation methods, trained on terrestrial-dominated datasets with limited underwater samples, may exhibit inadequate performance in underwater scenes. To address these issues, we introduce the first underwater camouflaged instance segmentation (UCIS) dataset, abbreviated as UCIS4K, which comprises 3,953 images of camouflaged marine organisms with instance-level annotations. In addition, we propose an Underwater Camouflaged Instance Segmentation network based on Segment Anything Model (UCIS-SAM). Our UCIS-SAM includes three key modules. First, the Channel Balance Optimization Module (CBOM) enhances channel characteristics to improve underwater feature learning, effectively addressing the model's limited understanding of underwater environments. Second, the Frequency Domain True Integration Module (FDTIM) is proposed to emphasize intrinsic object features and reduce interference from camouflage patterns, enhancing the segmentation performance of camouflaged objects blending with their surroundings. Finally, the Multi-scale Feature Frequency Aggregation Module (MFFAM) is designed to strengthen the boundaries of low-contrast camouflaged instances across multiple frequency bands, improving the model's ability to achieve more precise segmentation of camouflaged objects. Extensive experiments on the proposed UCIS4K and public benchmarks show that our UCIS-SAM outperforms state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。