SFFNet提升无人机图像目标检测,通过双域边缘增强与协同特征融合。
SFFNet: Synergistic Feature Fusion Network With Dual-Domain Edge Enhancement for UAV Image Object Detection
- 设计双域边缘提取模块,从频域和空域分离复杂背景中的多尺度边缘。
- 提出协同特征金字塔网络,用可变形卷积和广域感知模块增强几何与语义表征。
- 提供从轻量级到超大模型共六种版本,适配不同资源场景,性能领先。
无人机图像中的目标检测仍具挑战,主要源于背景噪声复杂和目标尺度不平衡。传统方法难以有效区分目标与复杂背景,且未能充分利用图像中的多尺度信息。为此,本文提出专用于无人机图像目标检测的协同特征融合网络(SFFNet),包含多尺度动态双域耦合(MDDC)模块,该模块在频率域和空间域双驱动下实现多尺度目标边缘与背景噪声的有效解耦。为进一步增强模型颈部对几何与语义信息的表达能力,提出协同特征金字塔网络(SFPN),利用线性可变形卷积自适应捕捉不规则目标形状,并通过广域感知模块(WPM)建立目标周围的长程上下文关联。此外,为适配多样化应用或资源受限场景,设计了六种不同规模的检测器(N/S/M/B/L/X)。在两个具有挑战性的航空数据集(VisDrone 和 UAVDT)上的实验表明,SFFNet-X 分别取得 36.8 AP 与 20.6 AP,轻量级模型(N/S)在精度与参数效率间保持良好平衡。
原文摘要 · Abstract (English)
Object detection in unmanned aerial vehicle (UAV) images remains a highly challenging task, primarily caused by the complexity of background noise and the imbalance of target scales. Traditional methods easily struggle to effectively separate objects from intricate backgrounds and fail to fully leverage the rich multi-scale information contained within images. To address these issues, we have developed a synergistic feature fusion network (SFFNet) with dual-domain edge enhancement specifically tailored for object detection in UAV images. Firstly, the multi-scale dynamic dual-domain coupling (MDDC) module is designed. This component introduces a dual-driven edge extraction architecture that operates in both the frequency and spatial domains, enabling effective decoupling of multi-scale object edges from background noise. Secondly, to further enhance the representation capability of the model's neck in terms of both geometric and semantic information, a synergistic feature pyramid network (SFPN) is proposed. SFPN leverages linear deformable convolutions to adaptively capture irregular object shapes and establishes long-range contextual associations around targets through the designed wide-area perception module (WPM). Moreover, to adapt to the various applications or resource-constrained scenarios, six detectors of different scales (N/S/M/B/L/X) are designed. Experiments on two challenging aerial datasets (VisDrone and UAVDT) demonstrate the outstanding performance of SFFNet-X, achieving 36.8 AP and 20.6 AP, respectively. The lightweight models (N/S) also maintain a balance between detection accuracy and parameter efficiency. The code will be available at https://github.com/CQNU-ZhangLab/SFFNet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。