arXiv:2503.02220cs.CV2025-03被引 3

改进红外小目标检测的低层特征学习,效率与精度双提升。

Low-Level Matters: An Efficient Hybrid Architecture for Robust Multi-frame Infrared Small Target Detection

  • 用多尺度卷积前端增强局部特征捕捉能力
  • 在IRDST和NUDT-MIRSDT上比最优方法高5.63%~18.36% nIoU
  • 参数量仅为1/221,计算成本大幅降低,适合部署

多帧红外小目标检测在低空及海面监视中至关重要。结合卷积神经网络与视觉变换器的混合架构在提升性能方面展现出巨大潜力。本文提出LVNet,一种简单而强大的混合架构,重新定义了混合框架中低层特征学习的方式。核心洞察是:标准视觉变换器中的线性图像块嵌入不足以捕捉红外小目标所依赖的尺度敏感局部特征。为此,我们设计了一个多尺度卷积前端,通过利用卷积的局部空间偏置显式建模局部特征;同时构建了一个U型视频变换器,用于建模多帧时空上下文,有效捕捉目标运动特性。在公开数据集IRDST和NUDT-MIRSDT上的实验表明,LVNet优于现有最先进方法。相比当前最佳方法LMAFormer,nIoU提升5.63%/18.36%,参数量仅为其1/221,计算成本分别为1/92和1/21。消融实验证明了低层表示学习在混合架构中的关键作用。代码与模型已开源。

原文摘要 · Abstract (English)

Multi-frame infrared small target detection (IRSTD) plays a crucial role in low-altitude and maritime surveillance. The hybrid architecture combining CNNs and Transformers shows great promise for enhancing multi-frame IRSTD performance. In this paper, we propose LVNet, a simple yet powerful hybrid architecture that redefines low-level feature learning in hybrid frameworks for multi-frame IRSTD. Our key insight is that the standard linear patch embeddings in Vision Transformers are insufficient for capturing the scale-sensitive local features critical to infrared small targets. To address this limitation, we introduce a multi-scale CNN frontend that explicitly models local features by leveraging the local spatial bias of convolution. Additionally, we design a U-shaped video Transformer for multi-frame spatiotemporal context modeling, effectively capturing the motion characteristics of targets. Experiments on the publicly available datasets IRDST and NUDT-MIRSDT demonstrate that LVNet outperforms existing state-of-the-art methods. Notably, compared to the current best-performing method, LMAFormer, LVNet achieves an improvement of 5.63\% / 18.36\% in nIoU, while using only 1/221 of the parameters and 1/92 / 1/21 of the computational cost. Ablation studies further validate the importance of low-level representation learning in hybrid architectures. Our code and trained models are available at https://github.com/ZhihuaShen/LVNet.

红外检测小目标混合架构高效模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。