arXiv:2502.06756cs.CV2025-02ICLR被引 18

用噪声鲁棒提示法提升SAM粗分割图质量,降低标注成本。

SAMRefiner: Taming Segment Anything Model for Universal Mask Refinement

  • 通过多提示挖掘策略生成多样提示,增强对粗糙掩码的容错能力。
  • 在多个数据集上优于现有方法,显著提升分割精度与效率。
  • 适合需要快速高质量分割的科研与工业场景使用。

本文探索了一种提升现有粗分割掩码质量的方法,使其可作为可靠训练数据,从而降低标注成本。不同于以往针对特定模型或任务的封闭世界精炼方法,我们提出SAMRefiner,一种通用且高效的基于SAM的掩码精炼方案。核心是噪声容忍提示机制:从初始粗掩码中挖掘多种提示(距离引导点、上下文感知弹性框、高斯风格掩码),协同缓解粗掩码缺陷。针对SAM处理多目标语义分割困难的问题,引入分治-合并(STM)流程。进一步通过引入自适应IoU步骤扩展为SAMRefiner++,无需额外标注即可提升性能。该框架灵活适配现有分割方法,在多种基准测试中表现更优,具有推动精炼工具发展的潜力。代码已开源。

原文摘要 · Abstract (English)

In this paper, we explore a principal way to enhance the quality of widely pre-existing coarse masks, enabling them to serve as reliable training data for segmentation models to reduce the annotation cost. In contrast to prior refinement techniques that are tailored to specific models or tasks in a close-world manner, we propose SAMRefiner, a universal and efficient approach by adapting SAM to the mask refinement task. The core technique of our model is the noise-tolerant prompting scheme. Specifically, we introduce a multi-prompt excavation strategy to mine diverse input prompts for SAM (i.e., distance-guided points, context-aware elastic bounding boxes, and Gaussian-style masks) from initial coarse masks. These prompts can collaborate with each other to mitigate the effect of defects in coarse masks. In particular, considering the difficulty of SAM to handle the multi-object case in semantic segmentation, we introduce a split-then-merge (STM) pipeline. Additionally, we extend our method to SAMRefiner++ by introducing an additional IoU adaption step to further boost the performance of the generic SAMRefiner on the target dataset. This step is self-boosted and requires no additional annotation. The proposed framework is versatile and can flexibly cooperate with existing segmentation methods. We evaluate our mask framework on a wide range of benchmarks under different settings, demonstrating better accuracy and efficiency. SAMRefiner holds significant potential to expedite the evolution of refinement tools. Our code is available at https://github.com/linyq2117/SAMRefiner.

掩码精炼SAM分割自适应

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。