针对无人机小目标检测,提出局部全局信息交互的端到端检测框架
LGI-DETR: Local-Global Interaction for UAV Object Detection

- 设计双向跨层特征增强机制,融合高低层特征
- 在VisDrone2019和UAVDT上AP提升1.9%,AP50提升2.4%
- 特别适合小目标检测,适用于无人机视觉任务
无人机在多个领域广泛应用,但现有大多数目标检测器非端到端,需复杂组件设计与精细调参。多数端到端检测器针对自然场景设计,直接用于无人机图像效果不佳。为此,本文提出面向无人机的小目标检测端到端框架LGI-DETR,通过跨层双向高低层特征增强,在小目标检测中表现优异。编码器初始阶段引入局部空间增强模块(LSE),将低层丰富局部空间信息注入高层特征,减少高层信息传递中的局部信息损失。编码器末尾设计全局信息注入模块(GII),将高层丰富的语义信息融入低层特征图,通过层级融合机制传播上下文信息,克服局部感受野固有局限。在两个挑战性无人机图像检测基准数据集VisDrone2019和UAVDT上的实验表明,所提模型优于当前最优方法,相比基线模型,平均精度(AP)提升1.9%,AP50提升2.4%。
原文摘要 · Abstract (English)
UAV has been widely used in various fields. However, most of the existing object detectors used in drones are not end-to-end and require the design of various complex components and careful fine-tuning. Most of the existing end-to-end object detectors are designed for natural scenes. It is not ideal to apply them directly to UAV images. In order to solve the above challenges, we design an local-global information interaction DETR for UAVs, namely LGI-DETR. Cross-layer bidirectional low-level and high-level feature information enhancement, this fusion method is effective especially in the field of small objection detection. At the initial stage of encoder, we propose a local spatial enhancement module (LSE), which enhances the low-level rich local spatial information into the high-level feature, and reduces the loss of local information in the transmission process of high-level information. At the final stage of the encoder, we propose a novel global information injection module (GII) designed to integrate rich high-level global semantic representations with low-level feature maps. This hierarchical fusion mechanism effectively addresses the inherent limitations of local receptive fields by propagating contextual information across the feature hierarchy. Experimental results on two challenging UAV image object detection benchmarks, VisDrone2019 and UAVDT, show that our proposed model outperforms the SOTA model. Compared to the baseline model, AP and AP50 improved by 1.9% and 2.4%, respectively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。