arXiv:2504.05049cs.CV2025-04被引 3

用数学映射优化图像定位先验,提升少样本分割精度

CMaP-SAM: Contraction Mapping Prior for SAM-driven Few-shot Segmentation

  • 引入压缩映射理论迭代优化位置先验,保证收敛
  • 在PASCAL-5i达71.1 mIoU,COCO-20i达56.1 mIoU
  • 适合需要高精度少样本分割的视觉任务研究者

少样本分割(FSS)旨在仅用少量标注图像对新类别进行分割。尽管近期方法通过利用通用分割模型SAM取得显著进展,但仍面临两大挑战:查询图像中结构相关性利用不足,以及将连续位置先验转换为离散点提示时的信息损失。为此,我们提出CMaP-SAM,一个基于压缩映射理论的新型框架,用于优化SAM驱动的少样本分割。该框架包含三个核心组件:(1) 压缩映射模块,将位置先验优化建模为具有收敛保证的Banach压缩映射,通过像素级结构相似性迭代细化位置先验,生成同时保留参考图语义引导与查询图结构相关性的收敛先验;(2) 自适应分布对齐模块,连接连续先验与SAM的二值掩码提示编码器;(3) 前背景解耦细化架构,生成精确最终分割掩码。大量实验表明,CMaP-SAM表现卓越,在PASCAL-5i上达到71.1 mIoU,COCO-20i上达到56.1 mIoU。代码已公开于https://github.com/Chenfan0206/CMaP-SAM。

原文摘要 · Abstract (English)

Few-shot segmentation (FSS) aims to segment new classes using few annotated images. While recent FSS methods have shown considerable improvements by leveraging Segment Anything Model (SAM), they face two critical limitations: insufficient utilization of structural correlations in query images, and significant information loss when converting continuous position priors to discrete point prompts. To address these challenges, we propose CMaP-SAM, a novel framework that introduces contraction mapping theory to optimize position priors for SAM-driven few-shot segmentation. CMaP-SAM consists of three key components: (1) a contraction mapping module that formulates position prior optimization as a Banach contraction mapping with convergence guarantees. This module iteratively refines position priors through pixel-wise structural similarity, generating a converged prior that preserves both semantic guidance from reference images and structural correlations in query images; (2) an adaptive distribution alignment module bridging continuous priors with SAM's binary mask prompt encoder; and (3) a foreground-background decoupled refinement architecture producing accurate final segmentation masks. Extensive experiments demonstrate CMaP-SAM's effectiveness, achieving state-of-the-art performance with 71.1 mIoU on PASCAL-$5^i$ and 56.1 on COCO-$20^i$ datasets. Code is available at https://github.com/Chenfan0206/CMaP-SAM.

少样本分割SAM压缩映射图像分割

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。