轻量级Mamba网络提升红外小目标检测精度与实时性
LCMamNet: A Lightweight Cross-scale Mamba Network for Infrared Small Target Detection

- 用交叉方向瓶颈块增强目标结构,节省计算资源
- 跨尺度融合模块在隐空间实现多层级交互,提升语义稳定性
- 适合边缘设备部署,实测推理延迟仅6.62毫秒
红外小目标检测(IRSTD)在低空感知、无人系统预警和安防监控中至关重要。然而,红外图像中的弱目标通常仅占几个像素,易被云雾杂波、地物边缘和亮噪声淹没,导致轻量级分割方法难以同时保留局部目标结构并抑制背景干扰。为此,我们提出LCMamNet,一种轻量级跨尺度Mamba网络,能逐步增强局部目标结构,通过隐空间进行跨尺度上下文交互,并在抑制背景的同时恢复空间细节。具体而言,采用紧凑的分层编码器,结合十字形方向性瓶颈残差(CDBR)块,在极小计算开销下强化方向敏感的目标特征;随后,潜空间密集跨尺度融合(LDCF)模块通过双向Mamba建模实现全层级密集交互,并重构为稳定的层次语义;最后,渐进式解码器选择性恢复浅层空间细节,同时抑制无关背景纹理。在IRSTD-1k、NUAA-SIRST和NUDT-SIRST数据集上的大量实验表明,该网络分别取得71.25%、79.60%和95.58%的mIoU,参数量仅1.175M,计算量为6.91 GFLOPs,平均推理延迟6.62毫秒。在NVIDIA Jetson Orin NX 16G SUPER上的部署结果进一步验证了其在实时边缘推理中的实际潜力。代码与模型权重已公开于https://github.com/Haoyu096/LCMamNet。
原文摘要 · Abstract (English)
Infrared small target detection (IRSTD) is important for low-altitude perception, unmanned-system warning, and security monitoring. However, weak targets in infrared imagery usually occupy only a few pixels and are easily submerged by cloud clutter, ground edges, and bright noise, making it difficult for lightweight segmentation-based methods to preserve local target structures while suppressing background interference. To address these challenges, we propose LCMamNet, a lightweight cross-scale Mamba network that progressively enhances local target structures, interacts cross-scale context in a latent space, and restores spatial details with background suppression. Specifically, a compact hierarchical encoder with cross-shaped directional bottleneck residual (CDBR) blocks strengthens direction-sensitive target structures under a small computation budget. A latent dense cross-scale fusion (LDCF) module then performs dense all-level interaction through bidirectional Mamba modeling and reorganizes the interacted features into stable hierarchical semantics. Finally, a progressive decoder selectively recovers shallow spatial details while suppressing irrelevant background textures. Extensive experiments on IRSTD-1k, NUAA-SIRST, and NUDT-SIRST show that the proposed network achieves mIoU scores of 71.25\%, 79.60\%, and 95.58\%, respectively, with only 1.175M parameters and 6.91 GFLOPs. It also runs with a mean inference latency of 6.62 ms, and deployment results on an NVIDIA Jetson Orin NX 16G SUPER further demonstrate its practical potential for real-time edge inference. The code and checkpoints are publicly available at https://github.com/Haoyu096/LCMamNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。