通过专家先验提升航拍图像中细微物体的识别精度
Hierarchical Fine-Grained Aerial Object Detection

- 引入视觉感知的属性建模,从图像恢复被遮蔽的属性特征
- 构建分层视觉原型树,增强不同层级类别的区分能力
- 新数据集PSP涵盖106类船、30种飞机,规模领先
细粒度航拍目标检测依赖真实世界物体类别内在的细致差异,对遥感场景理解至关重要。现有方法多沿用粗粒度检测范式,仅依赖单标签监督,难以区分结构差异微小的模型级类别。针对每种具体型号(如波音787),其属性与层级结构蕴含丰富的判别语义。为此,本文提出ExpertDet,融合专家先验知识以提升细粒度航拍目标检测性能。设计视觉感知掩码属性建模(VMAM),通过从视觉线索重建随机掩码属性,实现属性语义与视觉结构对齐,捕捉细微结构差异。进一步提出分层视觉实例促进(HierVIP),基于层级关系构建视觉原型树,并施加分类法感知约束,保持跨层级语义连续性的同时增强类别判别力。此外,构建新基准PSP,用于精确识别航拍图像中的型号特定船舶与飞机,覆盖106类船和30种飞机型号,是当前最全面的型号级航拍目标检测数据集。在PSP上对主流检测算法进行评估,结果表明ExpertDet在各层级上均显著优于其他细粒度检测方法。数据集、基准与代码已公开于https://nnnnerd.github.io/PSP-Benchmark/。
原文摘要 · Abstract (English)
Fine-grained aerial object detection, driven by the intrinsic granularity of real-world object categories, is crucial for advanced scene understanding in remote sensing. Existing methods largely inherit the paradigm of coarse-grained object detection, relying solely on single-label supervision and thus struggling to distinguish model-level categories with subtle structural differences. However, for each specific model (e.g., Boeing 787), structured prior knowledge such as attributes and hierarchies offers discriminative semantics across multiple granularities. Motivated by this, we present ExpertDet, a scheme that incorporates expert-informed cues to enhance fine-grained aerial object detection. Specifically, we design Vision-aware Masked Attribute Modeling (VMAM), which aligns attribute semantics with visual structures by reconstructing randomly masked attributes from visual cues, enabling the detector to capture subtle structural distinctions. We further propose Hierarchical Visual Instance Promotion (HierVIP), which builds a visual prototype tree based on hierarchical relations and imposes taxonomy-aware constraints to preserve cross-level semantic continuity while enhancing category discrimination. Moreover, we curate a new fine-grained object detection benchmark for Precise recognition of model-specific Ships and Planes from aerial imagery, PSP, covering 106 ship classes and 30 airplane models, respectively, featuring the most extensive collection of model-specific categories among existing aerial object detection datasets to date. We benchmark state-of-the-art object detection algorithms on the PSP benchmark. Extensive evaluation demonstrates that ExpertDet consistently outperforms other fine-grained competitors across hierarchy levels. The dataset, benchmark, and code are available at https://nnnnerd.github.io/PSP-Benchmark/.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。