arXiv:2602.21762cs.CV2026-02TPAMI被引 1

用单点提示实现精准实例分割,解决细节模糊与边界不准问题。

SAPNet++: Evolving Point-Prompted Instance Segmentation with Semantic and Spatial Awareness

  • 引入语义与空间感知机制,优化单点提示下的分割精度。
  • 在四个数据集上显著提升性能,边界不确定性大幅降低。
  • 适合研究高精度实例分割与弱监督学习的学者参考。

单点标注在视觉任务中因标注成本低而日益受到关注,但其对高精度任务如点提示实例分割(PPIS)构成挑战,该任务旨在通过单点提示训练网络生成精确掩码。由于点标注的限制,存在粒度模糊和边界不确定的问题,难以区分整体对象与局部部件,且难以精确定位边界。以往方法多沿用掩码生成与提议选择的范式,但提议选择仅依赖类别信息,无法解决粒度歧义;掩码生成器提供有限离散解,常偏离真实掩码,尤其在边界处。为此,本文提出语义感知点提示实例分割网络(SAPNet),融合点距离引导与框挖掘策略,应对粒度模糊带来的全局与局部问题。同时,在提议中引入完整性评分,增强空间粒度感知,改进多实例学习(MIL)方法,称为S-MIL。多层级亲和力精炼模块传递像素与语义线索,缩小边界不确定性。上述模块整合为SAPNet++,有效缓解点提示引起的粒度模糊与边界不确定,显著提升分割性能。在四个挑战性数据集上的大量实验验证了方法的有效性,凸显其推动PPIS发展的潜力。

原文摘要 · Abstract (English)

Single-point annotation is increasingly prominent in visual tasks for labeling cost reduction. However, it challenges tasks requiring high precision, such as the point-prompted instance segmentation (PPIS) task, which aims to estimate precise masks using single-point prompts to train a segmentation network. Due to the constraints of point annotations, granularity ambiguity and boundary uncertainty arise the difficulty distinguishing between different levels of detail (eg. whole object vs. parts) and the challenge of precisely delineating object boundaries. Previous works have usually inherited the paradigm of mask generation along with proposal selection to achieve PPIS. However, proposal selection relies solely on category information, failing to resolve the ambiguity of different granularity. Furthermore, mask generators offer only finite discrete solutions that often deviate from actual masks, particularly at boundaries. To address these issues, we propose the Semantic-Aware Point-Prompted Instance Segmentation Network (SAPNet). It integrates Point Distance Guidance and Box Mining Strategy to tackle group and local issues caused by the point's granularity ambiguity. Additionally, we incorporate completeness scores within proposals to add spatial granularity awareness, enhancing multiple instance learning (MIL) in proposal selection termed S-MIL. The Multi-level Affinity Refinement conveys pixel and semantic clues, narrowing boundary uncertainty during mask refinement. These modules culminate in SAPNet++, mitigating point prompt's granularity ambiguity and boundary uncertainty and significantly improving segmentation performance. Extensive experiments on four challenging datasets validate the effectiveness of our methods, highlighting the potential to advance PPIS.

实例分割点提示语义感知边界优化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。