用动态扫描与状态抑制提升水下实例分割精度
UIS-Mamba: Exploring Mamba for Underwater Instance Segmentation via Dynamic Tree Scan and Hidden State Weaken
- 引入动态树扫描,自适应调整补丁位置与尺度以保持目标连续性
- 通过Ncut机制削弱背景隐藏状态,使模型聚焦于目标对象
- 在两个水下数据集上达到顶尖性能,且参数与计算量低
水下实例分割对复杂水下场景检测至关重要。Mamba作为具有线性复杂度和全局感受野的新兴状态空间模型,适合处理长序列特征的图像分割任务。然而,由于水下场景特殊性,将Mamba应用于水下实例分割面临挑战:现有固定补丁扫描机制无法在严重颜色失真和模糊边界情况下保持目标内部特征连续性,复杂水下背景的隐藏状态也会抑制对目标物体的理解。本文提出首个基于Mamba的水下实例分割模型UIS-Mamba,设计两个创新模块:动态树扫描(DTS)通过允许补丁动态偏移与缩放,引导最小生成树并提供动态局部感受野,维持目标内部特征连续性;隐藏状态削弱(HSW)模块基于Ncut机制抑制复杂背景干扰,有效聚焦状态传播的信息流至目标本身。实验结果表明,UIS-Mamba在UIIS与USIS10K两个数据集上均达到当前最优性能,同时保持较低参数量与计算复杂度。代码已公开于https://github.com/Maricalce/UIS-Mamba。
原文摘要 · Abstract (English)
Underwater Instance Segmentation (UIS) tasks are crucial for underwater complex scene detection. Mamba, as an emerging state space model with inherently linear complexity and global receptive fields, is highly suitable for processing image segmentation tasks with long sequence features. However, due to the particularity of underwater scenes, there are many challenges in applying Mamba to UIS. The existing fixed-patch scanning mechanism cannot maintain the internal continuity of scanned instances in the presence of severely underwater color distortion and blurred instance boundaries, and the hidden state of the complex underwater background can also inhibit the understanding of instance objects. In this work, we propose the first Mamba-based underwater instance segmentation model UIS-Mamba, and design two innovative modules, Dynamic Tree Scan (DTS) and Hidden State Weaken (HSW), to migrate Mamba to the underwater task. DTS module maintains the continuity of the internal features of the instance objects by allowing the patches to dynamically offset and scale, thereby guiding the minimum spanning tree and providing dynamic local receptive fields. HSW module suppresses the interference of complex backgrounds and effectively focuses the information flow of state propagation to the instances themselves through the Ncut-based hidden state weakening mechanism. Experimental results show that UIS-Mamba achieves state-of-the-art performance on both UIIS and USIS10K datasets, while maintaining a low number of parameters and computational complexity. Code is available at https://github.com/Maricalce/UIS-Mamba.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。