构建首个面向无人机的全方位目标检测基准,提升真实场景泛化能力。
More Clear, More Flexible, More Precise: A Comprehensive Oriented Object Detection benchmark for UAV
- 针对低分辨率、单视角等四大缺陷设计改进方案
- 覆盖多城多光照数据,标注图像超万张
- 适配物流、农业等实际飞行场景,推动算法落地
无人机在物流、农业自动化、城市管理及应急响应中的应用高度依赖定向目标检测(OOD)以增强视觉感知。尽管现有无人机OOD数据集提供宝贵资源,但通常针对特定下游任务设计,导致在真实飞行场景中泛化性能有限,难以全面评估算法有效性。为弥补这一关键空白,我们提出CODrone——一个面向无人机的综合性定向目标检测数据集,真实反映现实条件,并作为新基准以匹配下游任务需求,提升应用适应性与鲁棒性。基于应用场景,我们识别出当前无人机OOD数据集的四大局限:低图像分辨率、对象类别有限、单视角成像、飞行高度受限,并提出相应改进以增强其适用性与鲁棒性。CODrone包含从多个城市采集、涵盖多种光照条件的广泛标注图像,显著提升基准真实性。为严格评估其作为新基准的有效性并深入理解其带来的新型挑战,我们基于22种经典或最先进方法开展系列实验。评估不仅验证了CODrone在真实场景中的表现力,也揭示了算法发展的关键瓶颈与机遇。总体而言,CODrone填补了无人机视角下定向目标检测的数据空白,提供了具备更强泛化能力的基准,更契合实际应用与未来算法研发。
原文摘要 · Abstract (English)
Applications of unmanned aerial vehicle (UAV) in logistics, agricultural automation, urban management, and emergency response are highly dependent on oriented object detection (OOD) to enhance visual perception. Although existing datasets for OOD in UAV provide valuable resources, they are often designed for specific downstream tasks.Consequently, they exhibit limited generalization performance in real flight scenarios and fail to thoroughly demonstrate algorithm effectiveness in practical environments. To bridge this critical gap, we introduce CODrone, a comprehensive oriented object detection dataset for UAVs that accurately reflects real-world conditions. It also serves as a new benchmark designed to align with downstream task requirements, ensuring greater applicability and robustness in UAV-based OOD.Based on application requirements, we identify four key limitations in current UAV OOD datasets-low image resolution, limited object categories, single-view imaging, and restricted flight altitudes-and propose corresponding improvements to enhance their applicability and robustness.Furthermore, CODrone contains a broad spectrum of annotated images collected from multiple cities under various lighting conditions, enhancing the realism of the benchmark. To rigorously evaluate CODrone as a new benchmark and gain deeper insights into the novel challenges it presents, we conduct a series of experiments based on 22 classical or SOTA methods.Our evaluation not only assesses the effectiveness of CODrone in real-world scenarios but also highlights key bottlenecks and opportunities to advance OOD in UAV applications.Overall, CODrone fills the data gap in OOD from UAV perspective and provides a benchmark with enhanced generalization capability, better aligning with practical applications and future algorithm development.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。