用逐步伪标注提升稀疏标注下的遥感目标检测精度
S$^2$Teacher: Step-by-step Teacher for Sparsely Annotated Oriented Object Detection
- 分步挖掘未标注目标的伪标签,逐步增强前景特征
- 仅用10%标注样本,在DOTA上接近全监督性能
- 适合遥感图像中人工标注成本高的场景
尽管全监督的定向目标检测在多模态遥感图像理解中取得显著进展,但依赖大量人工标注。近期研究尝试弱监督和半监督学习以减轻负担,却忽略了复杂遥感场景中密集标注带来的挑战。本文提出一种新设置:稀疏标注定向目标检测(SAOOD),仅标注部分实例,并针对其两大难题——稀疏标注导致的前景表征过拟合、未标注对象(假负例)干扰特征学习——提出S²Teacher方法。该方法逐步从易到难挖掘未标注对象的伪标签,强化前景表示;同时重加权未标注样本损失,降低其训练干扰。大量实验表明,S²Teacher在不同稀疏标注水平下均显著提升检测性能,在DOTA数据集上仅用10%标注实例即达到接近全监督的效果,有效平衡了检测精度与标注效率。代码将公开。
原文摘要 · Abstract (English)
Although fully-supervised oriented object detection has made significant progress in multimodal remote sensing image understanding, it comes at the cost of labor-intensive annotation. Recent studies have explored weakly and semi-supervised learning to alleviate this burden. However, these methods overlook the difficulties posed by dense annotations in complex remote sensing scenes. In this paper, we introduce a novel setting called sparsely annotated oriented object detection (SAOOD), which only labels partial instances, and propose a solution to address its challenges. Specifically, we focus on two key issues in the setting: (1) sparse labeling leading to overfitting on limited foreground representations, and (2) unlabeled objects (false negatives) confusing feature learning. To this end, we propose the S$^2$Teacher, a novel method that progressively mines pseudo-labels for unlabeled objects, from easy to hard, to enhance foreground representations. Additionally, it reweights the loss of unlabeled objects to mitigate their impact during training. Extensive experiments demonstrate that S$^2$Teacher not only significantly improves detector performance across different sparse annotation levels but also achieves near-fully-supervised performance on the DOTA dataset with only 10% annotation instances, effectively balancing detection accuracy with annotation efficiency. The code will be public.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。