提升红外小目标分割精度,强化多尺度对比与上下文信息
SFA-UNet: More Attention to Multi-Scale Contrast and Contextual Information in Infrared Small Object Segmentation
- 融合Scharr与快速傅里叶卷积,增强局部对比与多尺度上下文
- 在SIRST和IRSTD数据集上平均提升0.75%性能,方差仅0.025
- 适合红外图像中小目标检测与分割任务的研究者使用
近年来,计算机视觉领域对红外图像识别研究持续深入。尽管深度学习已成为主流方法,红外小目标分割(ISOS)仍面临三大挑战:1)局部对比与全局上下文信息利用不足;2)深层网络中目标易丢失;3)难以捕捉细粒度细节且易受噪声干扰。为此,本文提出改进型U-Net结构SFA-UNet,通过在编码器与解码器中引入Scharr卷积(SC)和快速傅里叶卷积(FFC),并结合垂直与水平注意力门(AG)。SC用于学习前景与背景的对比信息,FFC提供多尺度上下文信息,缓解小目标消失问题。编码器中的垂直注意力门可聚焦目标区域,抑制无关区域干扰。在公开数据集SIRST与IRSTD上的实验表明,该方法在多次运行中所有综合指标平均提升0.75%,方差为0.025,优于现有最先进方法。
原文摘要 · Abstract (English)
Computer vision researchers have extensively worked on fundamental infrared visual recognition for the past few decades. Among various approaches, deep learning has emerged as the most promising candidate. However, Infrared Small Object Segmentation (ISOS) remains a major focus due to several challenges including: 1) the lack of effective utilization of local contrast and global contextual information; 2) the potential loss of small objects in deep models; and 3) the struggling to capture fine-grained details and ignore noise. To address these challenges, we propose a modified U-Net architecture, named SFA-UNet, by combining Scharr Convolution (SC) and Fast Fourier Convolution (FFC) in addition to vertical and horizontal Attention gates (AG) into UNet. SFA-UNet utilizes double convolution layers with the addition of SC and FFC in its encoder and decoder layers. SC helps to learn the foreground-to-background contrast information whereas FFC provide multi-scale contextual information while mitigating the small objects vanishing problem. Additionally, the introduction of vertical AGs in encoder layers enhances the model's focus on the targeted object by ignoring irrelevant regions. We evaluated the proposed approach on publicly available, SIRST and IRSTD datasets, and achieved superior performance by an average 0.75% with variance of 0.025 of all combined metrics in multiple runs as compared to the existing state-of-the-art methods
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。