提升水下语义分割精度,关键在增强图像质量与多尺度特征融合
Improving underwater semantic segmentation with underwater image quality attention and muti-scale aggregation attention
- 设计水下图像质量注意力模块,强化高质量语义特征表达
- 引入多尺度聚合注意力,恢复因环境导致的细节丢失
- 结合边缘学习损失,显著改善物体边界分割清晰度
水下图像理解对潜航导航和海底探测至关重要。然而,水下环境光照不足会严重降低成像质量,进而严重影响语义分割性能,尤其在轮廓边界识别上表现不佳。为此,本文提出基于Transformer的水下语义分割框架UWSegFormer。首先,提出水下图像质量注意力(UIQA)模块,通过通道自注意力机制增强高质语义信息的表征。其次,设计多尺度聚合注意力(MAA)模块,从高层特征中提取判别性信息,聚合不同尺度的语义特征,补偿水下物体的语义细节损失。最后,在训练中引入边缘学习损失(ELL),增强模型对水下物体边缘的学习能力,提升预测精度。在SUIM和DUT-USEG(DUT)数据集上的实验表明,该方法在分割完整性、边界清晰度和主观感知细节方面优于当前最优方法。分别达到82.12和71.41的mIoU。代码将开源。
原文摘要 · Abstract (English)
Underwater image understanding is crucial for both submarine navigation and seabed exploration. However, the low illumination in underwater environments degrades the imaging quality, which in turn seriously deteriorates the performance of underwater semantic segmentation, particularly for outlining the object region boundaries. To tackle this issue, we present UnderWater SegFormer (UWSegFormer), a transformer-based framework for semantic segmentation of low-quality underwater images. Firstly, we propose the Underwater Image Quality Attention (UIQA) module. This module enhances the representation of highquality semantic information in underwater image feature channels through a channel self-attention mechanism. In order to address the issue of loss of imaging details due to the underwater environment, the Multi-scale Aggregation Attention(MAA) module is proposed. This module aggregates sets of semantic features at different scales by extracting discriminative information from high-level features,thus compensating for the semantic loss of detail in underwater objects. Finally, during training, we introduce Edge Learning Loss (ELL) in order to enhance the model's learning of underwater object edges and improve the model's prediction accuracy. Experiments conducted on the SUIM and DUT-USEG (DUT) datasets have demonstrated that the proposed method has advantages in terms of segmentation completeness, boundary clarity, and subjective perceptual details when compared to SOTA methods. In addition, the proposed method achieves the highest mIoU of 82.12 and 71.41 on the SUIM and DUT datasets, respectively. Code will be available at https://github.com/SAWRJJ/UWSegFormer.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。