针对遥感图像尺度变化大、背景复杂,提出多层级特征融合网络提升显著目标检测精度。
G2HFNet: GeoGran-Aware Hierarchical Feature Fusion Network for Salient Object Detection in Optical Remote Sensing Images
- 设计多尺度细节增强与地理粒度互补模块,捕捉不同层级的细节与位置信息。
- 在多个遥感数据集上实现领先性能,平均精度达87.6%以上。
- 适合遥感图像分析、城市规划、灾害监测等需要精准目标定位的场景。
从空中视角获取的遥感图像常存在显著尺度差异和复杂背景,给显著目标检测(SOD)带来挑战。现有方法通常在单一尺度上使用统一注意力机制提取多层级特征,导致表征不充分且检测结果不完整。为此,本文提出一种地理粒度感知的分层特征融合网络(G2HFNet),充分挖掘光学遥感图像中的几何与粒度线索。G2HFNet采用Swin Transformer作为骨干网络提取多层级特征,并集成三个关键模块:多尺度细节增强(MDE)模块用于处理对象尺度变化并丰富细粒度细节;双分支地理-粒度互补(DGC)模块联合捕获中层特征中的细粒度信息与位置信息;深层语义感知(DSP)模块通过自注意力机制精炼高层位置线索。此外,引入局部-全局引导融合(LGF)模块替代传统卷积,实现高效的多层级特征融合。大量实验表明,G2HFNet生成高质量显著图,在复杂遥感场景下显著提升检测性能。
原文摘要 · Abstract (English)
Remote sensing images captured from aerial perspectives often exhibit significant scale variations and complex backgrounds, posing challenges for salient object detection (SOD). Existing methods typically extract multi-level features at a single scale using uniform attention mechanisms, leading to suboptimal representations and incomplete detection results. To address these issues, we propose a GeoGran-Aware Hierarchical Feature Fusion Network (G2HFNet) that fully exploits geometric and granular cues in optical remote sensing images. Specifically, G2HFNet adopts Swin Transformer as the backbone to extract multi-level features and integrates three key modules: the multi-scale detail enhancement (MDE) module to handle object scale variations and enrich fine details, the dual-branch geo-gran complementary (DGC) module to jointly capture fine-grained details and positional information in mid-level features, and the deep semantic perception (DSP) module to refine high-level positional cues via self-attention. Additionally, a local-global guidance fusion (LGF) module is introduced to replace traditional convolutions for effective multi-level feature integration. Extensive experiments demonstrate that G2HFNet achieves high-quality saliency maps and significantly improves detection performance in challenging remote sensing scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。