arXiv:2504.07813cs.CV2025-04IJCV被引 2

用单点标注实现精准目标检测与分割,性能接近全监督方法。

P2Object: Single Point Supervised Object Detection and Instance Segmentation

  • 通过锚点式生成并分层优化实例级候选框,构建平衡的提案袋。
  • 在COCO等数据集上显著提升精度,均值平均精度超越以往方法。
  • 适合研究弱监督目标检测与实例分割的学者,尤其关注高效标注场景。

单点标注下的目标识别近年来受到广泛关注,但与全监督算法的性能差距仍较大。此前工作在图像层面离线生成类无关提议,并将混合候选视为单一包,给多实例学习(MIL)带来巨大负担。本文提出点到框网络(P2BNet),通过类似锚点的方式生成提议,并采用粗到精的范式进行优化,构建平衡的实例级提议袋。进一步研究发现,无论图像级或实例级提议袋均基于离散框采样,导致伪框估计次优,出现边界截断或背景过度包含。为此,我们探索离散到连续优化,提出P2BNet++和点到掩码网络(P2MNet)。P2BNet++通过更好利用空间线索实现近似连续提议采样;P2MNet引入低层图像信息辅助像素预测,并设计边界自预测机制,缓解框估计限制。得益于连续的对象感知像素级感知,P2MNet能生成更精确的边界框,并推广至分割任务。该方法在COCO、VOC、SBD和Cityscapes上的均值平均精度大幅超越先前方法,展现出缩小与全监督任务性能差距的巨大潜力。

原文摘要 · Abstract (English)

Object recognition using single-point supervision has attracted increasing attention recently. However, the performance gap compared with fully-supervised algorithms remains large. Previous works generated class-agnostic \textbf{\textit{proposals in an image}} offline and then treated mixed candidates as a single bag, putting a huge burden on multiple instance learning (MIL). In this paper, we introduce Point-to-Box Network (P2BNet), which constructs balanced \textbf{\textit{instance-level proposal bags}} by generating proposals in an anchor-like way and refining the proposals in a coarse-to-fine paradigm. Through further research, we find that the bag of proposals, either at the image level or the instance level, is established on discrete box sampling. This leads the pseudo box estimation into a sub-optimal solution, resulting in the truncation of object boundaries or the excessive inclusion of background. Hence, we conduct a series exploration of discrete-to-continuous optimization, yielding P2BNet++ and Point-to-Mask Network (P2MNet). P2BNet++ conducts an approximately continuous proposal sampling strategy by better utilizing spatial clues. P2MNet further introduces low-level image information to assist in pixel prediction, and a boundary self-prediction is designed to relieve the limitation of the estimated boxes. Benefiting from the continuous object-aware \textbf{\textit{pixel-level perception}}, P2MNet can generate more precise bounding boxes and generalize to segmentation tasks. Our method largely surpasses the previous methods in terms of the mean average precision on COCO, VOC, SBD, and Cityscapes, demonstrating great potential to bridge the performance gap compared with fully supervised tasks.

目标检测实例分割弱监督单点标注

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。