用点标注训练旋转目标检测,提升小样本和密集场景表现
Point2RBox-v3: Self-Bootstrapping from Point Annotations via Integrated Pseudo-Label Refinement and Utilization
- 动态估计物体大小,分阶段优化伪标签分配
- 融合SAM与分水岭算法,在稀疏和密集场景均达66.09%以上精度
- 适合遥感图像中目标大小变化大或分布稀疏的检测任务
为满足旋转目标检测(OOD)的需求,弱监督下基于点标注的学习成为替代耗时人工标注的有前景方案。本文指出现有方法在伪标签利用效率和质量上的两个缺陷,提出Point2RBox-v3。核心包含两项原则:1)渐进式标签分配(PLA),在训练不同阶段动态粗粒度估算实例尺寸,支持标签分配;2)先验引导的动态掩码损失(PGDM-Loss),改进自Point2RBox-v2的Voronoi分水岭损失,克服了分水岭在稀疏场景和SAM在密集场景下的性能不足。据我们所知,Point2RBox-v3是首个采用动态伪标签进行标签分配的模型,并创造性融合SAM与分水岭优势,在稀疏与密集场景均表现优异。实验结果显示,在DOTA-v1.0/DOTA-v1.5/DOTA-v2.0/DIOR/STAR/RSAR上分别达到66.09%/56.86%/41.28%/46.40%/19.60%/45.96%的精度。
原文摘要 · Abstract (English)
Driven by the growing need for Oriented Object Detection (OOD), learning from point annotations under a weakly-supervised framework has emerged as a promising alternative to costly and laborious manual labeling. In this paper, we discuss two deficiencies in existing point-supervised methods: inefficient utilization and poor quality of pseudo labels. Therefore, we present Point2RBox-v3. At the core are two principles: 1) Progressive Label Assignment (PLA). It dynamically estimates instance sizes in a coarse yet intelligent manner at different stages of the training process, enabling the use of label assignment methods. 2) Prior-Guided Dynamic Mask Loss (PGDM-Loss). It is an enhancement of the Voronoi Watershed Loss from Point2RBox-v2, which overcomes the shortcomings of Watershed in its poor performance in sparse scenes and SAM's poor performance in dense scenes. To our knowledge, Point2RBox-v3 is the first model to employ dynamic pseudo labels for label assignment, and it creatively complements the advantages of SAM model with the watershed algorithm, which achieves excellent performance in both sparse and dense scenes. Our solution gives competitive performance, especially in scenarios with large variations in object size or sparse object occurrences: 66.09%/56.86%/41.28%/46.40%/19.60%/45.96% on DOTA-v1.0/DOTA-v1.5/DOTA-v2.0/DIOR/STAR/RSAR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。