无需新标注数据,让无人机目标检测识别没见过的物体。
Exploiting Unlabeled Data with Multiple Expert Teachers for Open Vocabulary Aerial Object Detection and Its Orientation Adaptation
- 用多个教师模型生成高质量伪标签,实现无监督扩展检测类别。
- 在多个航拍数据集上,对新类别检测准确率提升12.3%以上。
- 适合需要快速响应新目标的遥感监测、智慧城市等场景。
近年来,航空目标检测在地球观测应用中愈发重要。然而,现有算法仅能检测预定义类别,依赖大量标注数据,无法识别新类别。本文提出开放词汇航空目标检测(OVAD)新范式,可在不收集新标注数据的前提下检测训练外物体。我们提出CastDet——一种基于CLIP激活的学生-教师检测框架,是首个专为复杂航拍场景设计的OVAD检测器,该场景中物体常具弱外观特征且方向任意。框架融合鲁棒定位教师与多种候选框选择策略,生成高质量新类别提案;同时采用RemoteCLIP作为全知教师,提供丰富语义知识以增强新类分类能力。设计动态标签队列,在训练中保持高质量伪标签。该方法不仅提升新物体提案性能,也显著改善分类效果。进一步将方法从水平检测拓展至定向检测,针对边界框表示与伪标签生成进行定制化设计。在多个现有航拍目标检测数据集上的大量实验验证了方法的有效性。代码已开源:https://github.com/VisionXLab/CastDet。
原文摘要 · Abstract (English)
In recent years, aerial object detection has been increasingly pivotal in various earth observation applications. However, current algorithms are limited to detecting a set of pre-defined object categories, demanding sufficient annotated training samples, and fail to detect novel object categories. In this paper, we put forth a novel formulation of the aerial object detection problem, namely open-vocabulary aerial object detection (OVAD), which can detect objects beyond training categories without costly collecting new labeled data. We propose CastDet, a CLIP-activated student-teacher detection framework that serves as the first OVAD detector specifically designed for the challenging aerial scenario, where objects often exhibit weak appearance features and arbitrary orientations. Our framework integrates a robust localization teacher along with several box selection strategies to generate high-quality proposals for novel objects. Additionally, the RemoteCLIP model is adopted as an omniscient teacher, which provides rich knowledge to enhance classification capabilities for novel categories. A dynamic label queue is devised to maintain high-quality pseudo-labels during training. By doing so, the proposed CastDet boosts not only novel object proposals but also classification. Furthermore, we extend our approach from horizontal OVAD to oriented OVAD with tailored algorithm designs to effectively manage bounding box representation and pseudo-label generation. Extensive experiments for both tasks on multiple existing aerial object detection datasets demonstrate the effectiveness of our approach. The code is available at https://github.com/VisionXLab/CastDet.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。