针对无人机图像中小物体多、类别不平衡问题,提出协同优化框架。
AD-Det: Boosting Object Detection in UAV Images with Focused Small Objects and Balanced Tail Classes
- 分阶段增强小物体区域并动态重采样稀有类别
- 在VisDrone上达37.5% AP,优于现有方法至少3.1%
- 适合处理复杂尺度与长尾分布的无人机目标检测任务
无人机图像中的目标检测面临显著挑战,主要源于物体尺度变化复杂以及类别间分布不均。现有方法通常分别处理这些问题,忽视了无人机图像中二者间的内在关联及潜在协同效应。为此,本文提出AD-Det框架,采用统一的粗到细策略,无缝集成两个关键组件:自适应小物体增强(ASOE)与动态类别平衡复制粘贴(DCC)。ASOE利用高分辨率特征图识别并聚类包含小物体的区域,随后放大并由细粒度检测器处理。DCC则基于ASOE获取的聚类中心,对尾部类别进行对象级重采样,并维护每个尾部类别的动态记忆库。该方法不仅精准提取小物体区域,还实现对稀有类别的合理动态重采样。因此,AD-Det通过协同自适应框架,有效应对无人机图像中的尺度变化与类别不平衡问题。我们在VisDrone和UAVDT两个公开数据集上进行了充分评估,结果表明AD-Det显著优于现有先进方法。特别地,在VisDrone数据集上达到37.5%的平均精度(AP),较现有方法至少提升3.1%。
原文摘要 · Abstract (English)
Object detection in Unmanned Aerial Vehicle (UAV) images poses significant challenges due to complex scale variations and class imbalance among objects. Existing methods often address these challenges separately, overlooking the intricate nature of UAV images and the potential synergy between them. In response, this paper proposes AD-Det, a novel framework employing a coherent coarse-to-fine strategy that seamlessly integrates two pivotal components: Adaptive Small Object Enhancement (ASOE) and Dynamic Class-balanced Copy-paste (DCC). ASOE utilizes a high-resolution feature map to identify and cluster regions containing small objects. These regions are subsequently enlarged and processed by a fine-grained detector. On the other hand, DCC conducts object-level resampling by dynamically pasting tail classes around the cluster centers obtained by ASOE, main-taining a dynamic memory bank for each tail class. This approach enables AD-Det to not only extract regions with small objects for precise detection but also dynamically perform reasonable resampling for tail-class objects. Consequently, AD-Det enhances the overall detection performance by addressing the challenges of scale variations and class imbalance in UAV images through a synergistic and adaptive framework. We extensively evaluate our approach on two public datasets, i.e., VisDrone and UAVDT, and demonstrate that AD-Det significantly outperforms existing competitive alternatives. Notably, AD-Det achieves a 37.5% Average Precision (AP) on the VisDrone dataset, surpassing its counterparts by at least 3.1%.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。