用分层视觉与状态空间模型提升红外小目标检测精度
SAMamba: Adaptive State Space Modeling with Hierarchical Vision for Infrared Small Target Detection
- 结合分层特征与选择性序列建模,自适应捕捉多尺度目标
- 在三个数据集上检测率显著超越现有方法,复杂背景表现尤佳
- 适合军事、海事等长距红外监测场景使用
红外小目标检测(ISTD)在军事、海事及早期预警等远程监控中至关重要。由于目标仅占图像面积的0.15%以下且与复杂背景区分度低,检测难度大。现有深度学习方法常因下采样导致信息丢失,且全局上下文建模效率低下。本文提出SAMamba框架,融合SAM2的分层特征学习与Mamba的选择性序列建模能力。创新点包括:(1) 特征选择适配器(FS-Adapter),通过双阶段选择(令牌级学习任务嵌入与通道自适应变换)实现自然图像到红外域的高效迁移;(2) 跨通道状态空间交互模块(CSI),以线性复杂度实现高效全局上下文建模;(3) 细节保持上下文融合模块(DPCF),通过门控机制自适应融合多尺度特征,平衡高分辨与低分辨特征贡献。SAMamba有效缓解领域差异、保留细节并高效建模长程依赖。在NUAA-SIRST、IRSTD-1k和NUDT-SIRST数据集上的实验表明,该方法显著优于当前最优方法,尤其在异质背景与不同目标尺度的挑战场景中表现突出。代码已开源。
原文摘要 · Abstract (English)
Infrared small target detection (ISTD) is vital for long-range surveillance in military, maritime, and early warning applications. ISTD is challenged by targets occupying less than 0.15% of the image and low distinguishability from complex backgrounds. Existing deep learning methods often suffer from information loss during downsampling and inefficient global context modeling. This paper presents SAMamba, a novel framework integrating SAM2's hierarchical feature learning with Mamba's selective sequence modeling. Key innovations include: (1) A Feature Selection Adapter (FS-Adapter) for efficient natural-to-infrared domain adaptation via dual-stage selection (token-level with a learnable task embedding and channel-wise adaptive transformations); (2) A Cross-Channel State-Space Interaction (CSI) module for efficient global context modeling with linear complexity using selective state space modeling; and (3) A Detail-Preserving Contextual Fusion (DPCF) module that adaptively combines multi-scale features with a gating mechanism to balance high-resolution and low-resolution feature contributions. SAMamba addresses core ISTD challenges by bridging the domain gap, maintaining fine-grained details, and efficiently modeling long-range dependencies. Experiments on NUAA-SIRST, IRSTD-1k, and NUDT-SIRST datasets show SAMamba significantly outperforms state-of-the-art methods, especially in challenging scenarios with heterogeneous backgrounds and varying target scales. Code: https://github.com/zhengshuchen/SAMamba.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。