arXiv:2605.24639cs.CVcs.AI2026-05

用遥感领域先验知识蒸馏,提升无人机图像开放词汇检测效果

DisDop: Distillation with Domain Priors for Open-Vocabulary Aerial Object Detection

论文配图:DisDop: Distillation with Domain Priors for Open-Vocabulary Aerial Object Detection
图 1 · 摘自论文原文
  • 融合遥感大模型的视觉与语义先验,蒸馏到轻量检测器中
  • 在DOTA、VisDrone等数据集上超越现有方法,小目标检测提升显著
  • 适合遥感图像检测、资源普查等需要开放类别识别的场景

近年来无人机广泛应用,航空图像目标检测日益重要,尤其是不受预设类别限制的开放词汇检测。由于无人机视角图像稀缺且与自然图像差异显著,直接套用为自然场景设计的开放词汇检测方法效果不佳。现有方法多依赖自然图像预训练模型,忽视了专为遥感和航空影像设计的基础模型潜力。为此,我们提出DisDop,一种统一框架,系统性地将遥感基础模型(如RemoteCLIP和DINOv3)中的多层次领域先验蒸馏至轻量检测器。首先,通过教师融合策略,结合RemoteCLIP的跨模态对齐能力与DINOv3的细粒度局部特征提取能力,传递互补优势至检测器主干;其次,显式建模RemoteCLIP文本编码器中的类别语义关系,并引入全局上下文先验,增强小目标的局部特征表示。该多层级先验蒸馏框架在开放词汇航空检测基准上取得新最优性能。大量消融实验验证了各模块的合理性和有效性。

原文摘要 · Abstract (English)

With the widespread application of drones in recent years, object detection of aerial images has attracted increasing attention, especially open-vocabulary aerial detection which is not restricted to predefined categories. Due to the scarcity of drone's viewpoint images and their significant differences from natural images, it is difficult to achieve satisfying results by directly applying vanilla open-vocabulary detection methods designed for natural scenarios. Some studies propose to transfer knowledge from pre-trained models by using lightweight networks or generating pseudo labels, but they tend to rely on models trained on natural images, neglecting the potential of foundation models specifically tailored for remote sensing and aerial imagery. To address this limitation, we propose DisDop, a unified framework that systematically distills multi-level domain priors from remote sensing foundation models (e.g., RemoteCLIP and DINOv3) into a lightweight detector. Specifically, we first distill visual priors through a teacher fusion strategy that combines RemoteCLIP's cross-modal alignment capability with DINOv3's fine-grained local feature extraction ability, transferring their complementary strengths to the detector's backbone. Second, we distill textual priors embedded in RemoteCLIP's text encoder by explicitly modeling inter-category semantic relationships, while incorporating global contextual priors to enhance local feature representation for small objects. Through this multi-level prior distillation framework, our DisDop achieves new state-of-the-art performance on open-vocabulary aerial detection benchmarks. Extensive ablation analysis also demonstrates the rationality and effectiveness of our proposed modules.

遥感检测开放词汇知识蒸馏小目标

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。