arXiv:2503.07115cs.CV2025-03被引 6

融合运动与外观信息,提升复杂背景中小无人机检测精度

YOLOMG: Vision-based Drone-to-Drone Detection with Appearance and Pixel-Level Motion Fusion

  • 通过运动差分图捕捉微小无人机的运动特征
  • 在ARD100数据集上平均检测精度达89.7%,优于现有方法
  • 适合需要高精度无人机侦测的飞行编队与反制场景

基于视觉的无人机间检测因在编队协同、空中避障及恶意无人机识别中的重要性而受到越来越多关注。然而,现有方法在背景复杂或目标微小时常失效。本文提出一种端到端框架,利用运动引导实现复杂环境下小无人机的精准检测:首先生成运动差分图以捕获微小无人机的运动特性;随后通过双模态融合模块将该图与RGB图像结合,实现自适应特征学习;最后经改进的YOLOv5骨干网络和检测头处理,获得高精度结果。为验证方法,我们构建新数据集ARD100,包含100个视频(202,467帧),涵盖多种挑战性条件,且平均目标尺寸为现有数据集中最小。在ARD100和NPS-Drones数据集上的大量实验表明,所提检测器在复杂条件下表现优异,各项指标超越当前最优算法。代码与数据集已公开于https://github.com/Irisky123/YOLOMG。

原文摘要 · Abstract (English)

Vision-based drone-to-drone detection has attracted increasing attention due to its importance in numerous tasks such as vision-based swarming, aerial see-and-avoid, and malicious drone detection. However, existing methods often encounter failures when the background is complex or the target is tiny. This paper proposes a novel end-to-end framework that accurately identifies small drones in complex environments using motion guidance. It starts by creating a motion difference map to capture the motion characteristics of tiny drones. Next, this motion difference map is combined with an RGB image using a bimodal fusion module, allowing for adaptive feature learning of the drone. Finally, the fused feature map is processed through an enhanced backbone and detection head based on the YOLOv5 framework to achieve accurate detection results. To validate our method, we propose a new dataset, named ARD100, which comprises 100 videos (202,467 frames) covering various challenging conditions and has the smallest average object size compared with the existing drone detection datasets. Extensive experiments on the ARD100 and NPS-Drones datasets show that our proposed detector performs exceptionally well under challenging conditions and surpasses state-of-the-art algorithms across various metrics. We publicly release the codes and ARD100 dataset at https://github.com/Irisky123/YOLOMG.

无人机检测运动感知多模态融合小目标检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。