轻量二值化网络提升红外小目标检测精度
10K is Enough: An Ultra-Lightweight Binarized Network for Infrared Small-Target Detection
- 提出点积二值卷积保留语义细节,兼顾效率
- 动态软符号函数提升梯度传播,改善训练稳定
- 仅用10K参数即达主流模型性能,适合边缘部署
红外小目标检测算法在边缘设备上的广泛应用亟需模型压缩技术。二值神经网络(BNNs)具有极高的压缩效率,但红外目标尺寸小,对精度要求高,而二值化过程固有的精度损失构成挑战。为此,我们提出二值化红外小目标检测网络(BiisNet),在保留二值卷积核心操作的同时,将全精度特征融入信息流。具体提出点积二值卷积,在保持二值运算优势的同时保留特征图的细粒度语义信息;并引入平滑自适应的动态软符号函数,在反向传播中提供更全面、渐进精细的梯度,增强模型稳定性并促进权重最优分布。实验表明,BiisNet不仅显著优于其他二值化架构,且在性能上具备与主流全精度模型竞争的能力。
原文摘要 · Abstract (English)
The widespread deployment of Infrared Small-Target Detection (IRSTD) algorithms on edge devices necessitates the exploration of model compression techniques. Binarized neural networks (BNNs) are distinguished by their exceptional efficiency in model compression. However, the small size of infrared targets introduces stringent precision requirements for the IRSTD task, while the inherent precision loss during binarization presents a significant challenge. To address this, we propose the Binarized Infrared Small-Target Detection Network (BiisNet), which preserves the core operations of binarized convolutions while integrating full-precision features into the network's information flow. Specifically, we propose the Dot Binary Convolution, which retains fine-grained semantic information in feature maps while still leveraging the binarized convolution operations. In addition, we introduce a smooth and adaptive Dynamic Softsign function, which provides more comprehensive and progressively finer gradient during backpropagation, enhancing model stability and promoting an optimal weight distribution. Experimental results demonstrate that BiisNet not only significantly outperforms other binary architectures but also has strong competitiveness among state-of-the-art full-precision models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。