arXiv:2512.24074cs.CV2025-12

解决遥感图像细粒度检测中层级标签不平衡与任务干扰问题。

Balanced Hierarchical Contrastive Learning with Decoupled Queries for Fine-grained Object Detection in Remote Sensing Images

  • 引入可学习类别原型和均衡梯度的损失函数,缓解层级标签分布不均。
  • 在三个数据集上性能超越当前最优方法,提升显著。
  • 适合需要精准分类与定位分离的遥感目标检测场景。

细粒度遥感数据集常采用分层标签结构,以粗到细的方式标注对象,每个对象在多个层级上被标注。然而,如何将这种语义层级嵌入表示学习空间以提升细粒度检测性能仍具挑战。现有研究在不同层级应用监督对比学习,以聚合同一父类下的对象并区分兄弟子类,但忽视了两个关键问题:(1) 标签层级中数据分布不均导致高频类别主导学习过程;(2) 类别间语义关系学习干扰无类别定位。为此,我们提出一种平衡分层对比损失,结合检测变换器(DETR)框架中的解耦学习策略。该损失引入可学习类别原型,并在每层级均衡各类别对损失的梯度贡献,确保每个层级类别在每个小批量中等权参与。解耦策略将DETR的对象查询分为分类与定位两组,实现任务特异性特征提取与优化。在三个具有层级标注的细粒度数据集上的实验表明,本方法优于当前最优方法。

原文摘要 · Abstract (English)

Fine-grained remote sensing datasets often use hierarchical label structures to differentiate objects in a coarse-to-fine manner, with each object annotated across multiple levels. However, embedding this semantic hierarchy into the representation learning space to improve fine-grained detection performance remains challenging. Previous studies have applied supervised contrastive learning at different hierarchical levels to group objects under the same parent class while distinguishing sibling subcategories. Nevertheless, they overlook two critical issues: (1) imbalanced data distribution across the label hierarchy causes high-frequency classes to dominate the learning process, and (2) learning semantic relationships among categories interferes with class-agnostic localization. To address these issues, we propose a balanced hierarchical contrastive loss combined with a decoupled learning strategy within the detection transformer (DETR) framework. The proposed loss introduces learnable class prototypes and equilibrates gradients contributed by different classes at each hierarchical level, ensuring that each hierarchical class contributes equally to the loss computation in every mini-batch. The decoupled strategy separates DETR's object queries into classification and localization sets, enabling task-specific feature extraction and optimization. Experiments on three fine-grained datasets with hierarchical annotations demonstrate that our method outperforms state-of-the-art approaches.

遥感检测层级学习对比学习DETR

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。