用点标注实现高鲁棒性小目标检测,无需框标注
Tiny Object Detection with Single Point Supervision
- 设计教师-学生框架,分两阶段去噪点标注噪声
- 在三个数据集上仅用点标注即达框标注模型性能
- 适合遥感图像中小目标检测且标注成本低的场景
小目标空间分辨率低,常表现为点状分布。因此,以点级标注替代传统框级标注成为自然且低成本的方案。然而,小目标尺度小、特征不显著,导致点标注易受噪声影响,严重制约模型鲁棒性。为此,本文提出首个端到端点监督的小目标检测方法 Point Teacher。为应对标注尺度模糊和位置偏移带来的噪声,该方法采用教师-学生架构,并将学习过程解耦为两阶段去噪:第一阶段通过随机掩蔽图像区域促进回归学习,使教师网络将噪声点标注转换为粗略伪框;第二阶段利用动态多实例学习,从围绕粗伪框构建的提案袋中自适应选择最可靠实例进行精修。在 AI-TOD-v2、SODA-A 和 TinyPerson 三个小目标数据集上的大量实验验证了该方法的有效性与鲁棒性。值得注意的是,仅依赖点标注,Point Teacher 的性能已与框监督方法相当。代码与模型将公开。
原文摘要 · Abstract (English)
Tiny objects, with their limited spatial resolution, often resemble point-like distributions. As a result, bounding box prediction using point-level supervision emerges as a natural and cost-effective alternative to traditional box-level supervision. However, the small scale and lack of distinctive features of tiny objects make point annotations prone to noise, posing significant hurdles for model robustness. To tackle these challenges, we propose Point Teacher--the first end-to-end point-supervised method for robust tiny object detection in aerial images. To handle label noise from scale ambiguity and location shifts in point annotations, Point Teacher employs the teacher-student architecture and decouples the learning into a two-phase denoising process. In this framework, the teacher network progressively denoises the pseudo boxes derived from noisy point annotations, guiding the student network's learning. Specifically, in the first phase, random masking of image regions facilitates regression learning, enabling the teacher to transform noisy point annotations into coarse pseudo boxes. In the second phase, these coarse pseudo boxes are refined using dynamic multiple instance learning, which adaptively selects the most reliable instance from dynamically constructed proposal bags around the coarse pseudo boxes. Extensive experiments on three tiny object datasets (i.e., AI-TOD-v2, SODA-A, and TinyPerson) validate the proposed method's effectiveness and robustness against point location shifts. Notably, relying solely on point supervision, our Point Teacher already shows comparable performance with box-supervised learning methods. Codes and models will be made publicly available.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。