针对无人机小目标密集检测,提出高效实时新模型RemDet。
RemDet: Rethinking Efficient Model Design for UAV Object Detection
- 以信息损失为设计指南,重构高效模型结构。
- 在VisDrone上提升检测精度超3.4%,达110帧/秒。
- 适合资源受限场景下的实时无人机目标检测。
无人机图像中的目标检测已成为研究热点,面临两大挑战:一是图像中目标小且密集;二是计算资源有限,多数模型无法实现实时部署。现有实时检测器未针对无人机图像优化,而专为小目标设计的复杂方法通常缺乏实时性。为此,本文提出新型检测器RemDet(Reparameter efficient multiplication Detector)。首先,重新思考现有检测器在小而密无人机图像上的局限,提出以信息损失为高效模型设计准则。其次,引入ChannelC2f模块,通过高维表示有效缓解信息丢失。第三,设计GatedFFN模块,在保证强性能的同时实现低延迟,证明乘法运算对高维表征更具成本效益。第四,提出CED模块,融合ViT与CNN下采样优势,有效减少信息损失,特别增强小而密目标的上下文信息。在大规模无人机数据集Visdrone和UAVDT上的大量实验验证了方法的实时效率与卓越性能。在具有挑战性的VisDrone数据集上,不仅达到领先水平,检测精度提升超过3.4%,且在单张4090显卡上实现110 FPS。
原文摘要 · Abstract (English)
Object detection in Unmanned Aerial Vehicle (UAV) images has emerged as a focal area of research, which presents two significant challenges: i) objects are typically small and dense within vast images; ii) computational resource constraints render most models unsuitable for real-time deployment. Current real-time object detectors are not optimized for UAV images, and complex methods designed for small object detection often lack real-time capabilities. To address these challenges, we propose a novel detector, RemDet (Reparameter efficient multiplication Detector). Our contributions are as follows: 1) Rethinking the challenges of existing detectors for small and dense UAV images, and proposing information loss as a design guideline for efficient models. 2) We introduce the ChannelC2f module to enhance small object detection performance, demonstrating that high-dimensional representations can effectively mitigate information loss. 3) We design the GatedFFN module to provide not only strong performance but also low latency, effectively addressing the challenges of real-time detection. Our research reveals that GatedFFN, through the use of multiplication, is more cost-effective than feed-forward networks for high-dimensional representation. 4) We propose the CED module, which combines the advantages of ViT and CNN downsampling to effectively reduce information loss. It specifically enhances context information for small and dense objects. Extensive experiments on large UAV datasets, Visdrone and UAVDT, validate the real-time efficiency and superior performance of our methods. On the challenging UAV dataset VisDrone, our methods not only provided state-of-the-art results, improving detection by more than 3.4%, but also achieve 110 FPS on a single 4090.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。