提升无人机图像小目标检测效率,融合频域与语义信息实现实时高精度识别。
EFSI-DETR: Efficient Frequency-Semantic Integration for Real-Time Small Object Detection in UAV Imagery
- 通过动态频域-空间协同网络,联合利用频率与空间信息增强多尺度特征融合。
- 在VisDrone上小目标AP提升5.8%,推理速度达188 FPS,兼顾精度与实时性。
- 适合需要快速精准检测小目标的无人机视觉应用,如巡检、追踪场景。
无人机影像中的实时小目标检测仍面临特征表达不足与多尺度融合低效的问题。现有方法未能充分挖掘频域信息,依赖静态卷积操作,限制了丰富特征表示能力,阻碍深层语义特征的有效提取。为此,我们提出EFSI-DETR框架,融合高效语义增强与动态频域-空间引导机制。该框架包含两个核心组件:(1) 动态频域-空间统一协同网络(DyFusNet),联合利用频域与空间线索实现鲁棒的多尺度特征融合;(2) 高效语义特征聚焦器(ESFC),以极低计算成本实现深度语义提取。此外,采用细粒度特征保留策略,在融合过程中引入富含空间细节的浅层特征,有效保持小目标关键细节。在VisDrone与CODrone数据集上的大量实验表明,所提EFSI-DETR达到当前最优性能,兼具实时性:在VisDrone上AP与AP$_{s}$分别提升1.6%和5.8%,单张RTX 4090 GPU下推理速度达188 FPS。
原文摘要 · Abstract (English)
Real-time small object detection in Unmanned Aerial Vehicle (UAV) imagery remains challenging due to limited feature representation and ineffective multi-scale fusion. Existing methods underutilize frequency information and rely on static convolutional operations, which constrain the capacity to obtain rich feature representations and hinder the effective exploitation of deep semantic features. To address these issues, we propose EFSI-DETR, a novel detection framework that integrates efficient semantic feature enhancement with dynamic frequency-spatial guidance. EFSI-DETR comprises two main components: (1) a Dynamic Frequency-Spatial Unified Synergy Network (DyFusNet) that jointly exploits frequency and spatial cues for robust multi-scale feature fusion, (2) an Efficient Semantic Feature Concentrator (ESFC) that enables deep semantic extraction with minimal computational cost. Furthermore, a Fine-grained Feature Retention (FFR) strategy is adopted to incorporate spatially rich shallow features during fusion to preserve fine-grained details, crucial for small object detection in UAV imagery. Extensive experiments on VisDrone and CODrone benchmarks demonstrate that our EFSI-DETR achieves the state-of-the-art performance with real-time efficiency, yielding improvement of \textbf{1.6}\% and \textbf{5.8}\% in AP and AP$_{s}$ on VisDrone, while obtaining \textbf{188} FPS inference speed on a single RTX 4090 GPU.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。