融合频域与空间域信息,提升遥感图像显著目标检测精度
United Domain Cognition Network for Salient Object Detection in Optical Remote Sensing Images
- 通过傅里叶变换获取全局频率特征,弥补局部像素信息不足
- 在三个公开数据集上超越24种先进方法,最高提升6.2%
- 适合遥感图像分析、智能解译等场景的科研与工程应用
近年来,基于深度学习的光学遥感图像显著目标检测(ORSIs-SOD)取得了显著进展。现有方法普遍聚焦于空间域中像素特征的优化,逐步区分背景与目标。然而,像素信息仅反映局部属性,常受周围上下文影响。即使采用扩展局部区域的策略,空间特征仍偏向局部特性,缺乏全局感知能力。为此,本文引入傅里叶变换生成全局频率特征,实现图像级感受野。具体地,提出统一域认知网络(UDCNet),联合探索频域与空间域的全局-局部信息。技术上,设计频-空域变换器模块,相互融合互补的局部空间特征与全局频率特征,增强初始输入表示。进一步构建密集语义挖掘模块,捕获高层语义以指导遥感目标定位。最后,设计双分支联合优化解码器,通过显著性与边缘分支生成高质量表征,预测显著目标。实验结果表明,所提UDCNet在三个常用ORSIs-SOD数据集上优于24种先进模型,通过大量定量与定性对比验证其优越性。
原文摘要 · Abstract (English)
Recently, deep learning-based salient object detection (SOD) in optical remote sensing images (ORSIs) have achieved significant breakthroughs. We observe that existing ORSIs-SOD methods consistently center around optimizing pixel features in the spatial domain, progressively distinguishing between backgrounds and objects. However, pixel information represents local attributes, which are often correlated with their surrounding context. Even with strategies expanding the local region, spatial features remain biased towards local characteristics, lacking the ability of global perception. To address this problem, we introduce the Fourier transform that generate global frequency features and achieve an image-size receptive field. To be specific, we propose a novel United Domain Cognition Network (UDCNet) to jointly explore the global-local information in the frequency and spatial domains. Technically, we first design a frequency-spatial domain transformer block that mutually amalgamates the complementary local spatial and global frequency features to strength the capability of initial input features. Furthermore, a dense semantic excavation module is constructed to capture higher-level semantic for guiding the positioning of remote sensing objects. Finally, we devise a dual-branch joint optimization decoder that applies the saliency and edge branches to generate high-quality representations for predicting salient objects. Experimental results demonstrate the superiority of the proposed UDCNet method over 24 state-of-the-art models, through extensive quantitative and qualitative comparisons in three widely-used ORSIs-SOD datasets. The source code is available at: \href{https://github.com/CSYSI/UDCNet}{\color{blue} https://github.com/CSYSI/UDCNet}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。