通过自适应稀疏化点提示,提升SAM在跨域少样本分割中的表现。
Boosting SAM for Cross-Domain Few-Shot Segmentation via Conditional Point Sparsification
- 根据参考图自适应稀疏匹配点,增强跨域一致性
- 在医学与卫星图像上显著优于现有无训练方法
- 适合医疗、遥感等跨域少样本分割场景
受通用分割模型SAM在可提示分割中成功启发,近期研究利用SAM开发无需训练的少样本分割方法,即基于少量参考示例预测目标图像中的对象掩码。这些基于SAM的方法通常依赖于参考图与目标图之间的点匹配,并使用匹配的密集点作为掩码预测的提示。然而我们发现,在跨域少样本分割(CD-FSS)中,目标图像来自医学或卫星领域时,密集点表现不佳。这归因于大域偏移破坏了SAM所学习的点-图像交互关系,且点密度在此类条件下起关键作用。为此,我们提出条件点稀疏化(CPS),一种无需训练的方法,可根据参考示例自适应引导跨域图像中SAM的交互。借助真实掩码,参考图像提供可靠指导以自适应稀疏化密集匹配点,从而实现更精确的分割结果。大量实验表明,CPS在多种CD-FSS数据集上均优于现有无训练的SAM基线方法。
原文摘要 · Abstract (English)
Motivated by the success of the Segment Anything Model (SAM) in promptable segmentation, recent studies leverage SAM to develop training-free solutions for few-shot segmentation, which aims to predict object masks in the target image based on a few reference exemplars. These SAM-based methods typically rely on point matching between reference and target images and use the matched dense points as prompts for mask prediction. However, we observe that dense points perform poorly in Cross-Domain Few-Shot Segmentation (CD-FSS), where target images are from medical or satellite domains. We attribute this issue to large domain shifts that disrupt the point-image interactions learned by SAM, and find that point density plays a crucial role under such conditions. To address this challenge, we propose Conditional Point Sparsification (CPS), a training-free approach that adaptively guides SAM interactions for cross-domain images based on reference exemplars. Leveraging ground-truth masks, the reference images provide reliable guidance for adaptively sparsifying dense matched points, enabling more accurate segmentation results. Extensive experiments demonstrate that CPS outperforms existing training-free SAM-based methods across diverse CD-FSS datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。