arXiv:2409.19833cs.CV2024-09被引 52

首个针对雾霾场景的无人机目标检测基准,提升复杂环境感知能力

HazyDet: Open-Source Benchmark for Drone-View Object Detection with Depth-Cues in Hazy Scenes

  • 引入深度条件核动态调节特征,融合深度线索增强识别
  • 在真实雾霾测试中达1.5% mAP提升,优于现有方法
  • 适合研究无人机视觉、恶劣天气感知的开发者使用

在恶劣大气条件下(尤其是雾霾)从空中平台进行目标检测对实现可靠的无人机自主至关重要。然而,该领域仍严重缺乏专用基准。为此,我们提出首个大规模基准HazyDet,专为雾霾环境下无人机视角的目标检测设计。数据集包含38.3万条真实世界实例,来自自然雾霾图像及合成雾霾增强的清晰图像。为应对雾霾导致的严重视觉退化,我们提出深度条件检测器(DeCoDet),通过深度条件核动态调节特征表示。其训练采用渐进域微调策略缓解合成到真实的数据域偏移,并结合尺度不变修复损失(SIRLoss)以应对可能噪声较大的深度标注。在HazyDet上的全面实验证明,该统一框架性能领先,于挑战性真实雾霾测试中较最接近竞争者提升1.5% mAP。数据集与工具包已开源:https://github.com/GrokCV/HazyDet。

原文摘要 · Abstract (English)

Object detection from aerial platforms under adverse atmospheric conditions, particularly haze, is paramount for robust drone autonomy. Yet, this domain remains largely underexplored, primarily hindered by the absence of specialized benchmarks. To bridge this gap, we present \textit{HazyDet}, the first, large-scale benchmark specifically designed for drone-view object detection in hazy conditions. Comprising 383,000 real-world instances derived from both naturally hazy captures and synthetically hazed scenes augmented from clear images, HazyDet provides a challenging and realistic testbed for advancing detection algorithms. To address the severe visual degradation induced by haze, we propose the Depth-Conditioned Detector (DeCoDet), a novel architecture that integrates a Depth-Conditioned Kernel to dynamically modulate feature representations based on depth cues. The practical efficacy and robustness of DeCoDet are further enhanced by its training with a Progressive Domain Fine-Tuning (PDFT) strategy to navigate synthetic-to-real domain shifts, and a Scale-Invariant Refurbishment Loss (SIRLoss) to ensure resilient learning from potentially noisy depth annotations. Comprehensive empirical validation on HazyDet substantiates the superiority of our unified DeCoDet framework, which achieves state-of-the-art performance, surpassing the closest competitor by a notable +1.5\% mAP on challenging real-world hazy test scenarios. Our dataset and toolkit are available at https://github.com/GrokCV/HazyDet.

目标检测无人机雾霾深度线索

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。