arXiv:2602.07827cs.CV2026-02被引 2

首个统一航拍视觉定位与开放词汇检测的实时框架

Open-Text Aerial Detection: A Unified Framework For Aerial Visual Grounding And Detection

  • 将两种任务统一为共享架构,用密集监督信号联合训练
  • 支持多目标检测与细粒度语义理解,6个基准上达最优
  • 基于RT-DETR改造,34帧/秒实现实时推理,适合航拍应用

开放词汇航拍检测(OVAD)和遥感视觉定位(RSVG)是航拍场景理解的两大范式。然而两者孤立运行时各有局限:OVAD仅限粗粒度类别语义,RSVG则受限于单目标定位。为此,我们提出OTA-Det,首个将两类任务统一的框架。通过任务重构策略,统一目标任务与监督机制,实现跨两类数据集的联合训练并获取密集监督信号;提出密集语义对齐策略,在整体表达到个体属性等多个粒度上建立显式对应,实现细粒度语义理解。为保障实时性,基于RT-DETR架构扩展,引入多个高效模块,将封闭集检测拓展至开放文本检测,在六个涵盖OVAD与RSVG任务的基准上取得领先性能,同时保持34 FPS的实时推理速度。

原文摘要 · Abstract (English)

Open-Vocabulary Aerial Detection (OVAD) and Remote Sensing Visual Grounding (RSVG) have emerged as two key paradigms for aerial scene understanding. However, each paradigm suffers from inherent limitations when operating in isolation: OVAD is restricted to coarse category-level semantics, while RSVG is structurally limited to single-target localization. These limitations prevent existing methods from simultaneously supporting rich semantic understanding and multi-target detection. To address this, we propose OTA-Det, the first unified framework that bridges both paradigms into a cohesive architecture. Specifically, we introduce a task reformulation strategy that unifies task objectives and supervision mechanisms, enabling joint training across datasets from both paradigms with dense supervision signals. Furthermore, we propose a dense semantic alignment strategy that establishes explicit correspondence at multiple granularities, from holistic expressions to individual attributes, enabling fine-grained semantic understanding. To ensure real-time efficiency, OTA-Det builds upon the RT-DETR architecture, extending it from closed-set detection to open-text detection by introducing several high efficient modules, achieving state-of-the-art performance on six benchmarks spanning both OVAD and RSVG tasks while maintaining real-time inference at 34 FPS.

航拍检测开放词汇实时推理视觉定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。