针对无人机运动模糊图像,提出双流融合检测网络,提升识别准确率。
DREB-Net: Dual-stream Restoration Embedding Blur-feature Fusion Network for High-mobility UAV Object Detection
- 双流结构:训练时加入图像复原分支,推理时移除以提速
- 多层级注意力融合浅层特征,增强关键信息表达能力
- 引入频域调制模块,提升对模糊图像的特征处理能力
高机动性无人机拍摄的图像常因运动模糊导致目标检测性能下降。为此,本文提出DREB-Net(双流复原嵌入模糊特征融合网络),在训练阶段引入模糊图像复原辅助分支(BRAB),通过均方误差(MSE)与结构相似性(SSIM)联合损失实现图像复原。采用多级注意力引导特征融合(MAGFF)模块,结合局部与全局注意力机制,动态加权不同分支特征。推理阶段可移除深层复原分支,降低计算开销,提升检测速度。此外,在早期特征提取中引入可学习频域幅度调制模块(LFAMM),利用快速傅里叶变换调整特征幅度,强化特征表达能力。实验表明,DREB-Net在存在运动模糊的图像上仍能有效完成目标检测任务,展现出优异性能和广泛应用前景。
原文摘要 · Abstract (English)
Object detection algorithms are pivotal components of unmanned aerial vehicle (UAV) imaging systems, extensively employed in complex fields. However, images captured by high-mobility UAVs often suffer from motion blur cases, which significantly impedes the performance of advanced object detection algorithms. To address these challenges, we propose an innovative object detection algorithm specifically designed for blurry images, named DREB-Net (Dual-stream Restoration Embedding Blur-feature Fusion Network). First, DREB-Net addresses the particularities of blurry image object detection problem by incorporating a Blurry image Restoration Auxiliary Branch (BRAB) during the training phase. Second, it fuses the extracted shallow features via Multi-level Attention-Guided Feature Fusion (MAGFF) module, to extract richer features. Here, the MAGFF module comprises local attention modules and global attention modules, which assign different weights to the branches. Then, during the inference phase, the deep feature extraction of the BRAB can be removed to reduce computational complexity and improve detection speed. In loss function, a combined loss of MSE and SSIM is added to the BRAB to restore blurry images. Finally, DREB-Net introduces Fast Fourier Transform in the early stages of feature extraction, via a Learnable Frequency domain Amplitude Modulation Module (LFAMM), to adjust feature amplitude and enhance feature processing capability. Experimental results indicate that DREB-Net can still effectively perform object detection tasks under motion blur in captured images, showcasing excellent performance and broad application prospects. Our source code will be available at https://github.com/EEIC-Lab/DREB-Net.git.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。