arXiv:2503.17820cs.CV2025-03

用参考图指导交互分割,解决用户点击模糊导致的分割不准问题

RefCut: Interactive Segmentation with Reference Guidance

  • 用户提供参考图像和掩码,模型据此优化分割
  • 在多个数据集上达到当前最好效果,显著提升分割一致性
  • 适合需要高效标注大量相似目标的场景

交互式分割通过用户正负点击实现目标分割,但存在交互歧义问题——相同点击可能对应多种合理结果,如只选物体局部或整个物体、单一物体或多个物体组合等。现有方法缺乏直观引导,导致输出不稳定,难以满足大规模高效标注需求。为此,我们提出RefCut,一种基于参考图像的交互分割框架,可有效缓解部分歧义与对象歧义。用户仅需提供参考图像及对应掩码,模型即据此优化,大幅降低标注负担。此外,我们构建了新数据集Target Disassembly,包含部分拆解与对象拆解两个子集用于评估。在多数据集联合测试中,RefCut表现优于现有方法。大量实验与可视化结果表明,该方法显著提升了交互分割的直观性与可控性。代码将公开,演示视频见https://www.lin-zheng.com/refcut。

原文摘要 · Abstract (English)

Interactive segmentation aims to segment the specified target on the image with positive and negative clicks from users. Interactive ambiguity is a crucial issue in this field, which refers to the possibility of multiple compliant outcomes with the same clicks, such as selecting a part of an object versus the entire object, a single object versus a combination of multiple objects, and so on. The existing methods cannot provide intuitive guidance to the model, which leads to unstable output results and makes it difficult to meet the large-scale and efficient annotation requirements for specific targets in some scenarios. To bridge this gap, we introduce RefCut, a reference-based interactive segmentation framework designed to address part ambiguity and object ambiguity in segmenting specific targets. Users only need to provide a reference image and corresponding reference masks, and the model will be optimized based on them, which greatly reduces the interactive burden on users when annotating a large number of such targets. In addition, to enrich these two kinds of ambiguous data, we propose a new Target Disassembly Dataset which contains two subsets of part disassembly and object disassembly for evaluation. In the combination evaluation of multiple datasets, our RefCut achieved state-of-the-art performance. Extensive experiments and visualized results demonstrate that RefCut advances the field of intuitive and controllable interactive segmentation. Our code will be publicly available and the demo video is in https://www.lin-zheng.com/refcut.

交互分割参考引导标注效率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。