不训练也能精准分割医学影像,靠的是找相似结构+自动调形+智能提示。
RAP: Retrieve, Adapt, and Prompt-Fit for Training-Free Few-Shot Medical Image Segmentation
- 从档案库中检索形态相似的样本,避免单一支持样本太脆弱。
- 通过边界特征适配,生成符合解剖结构的初始分割图。
- 用几何采样生成正负点提示,直接驱动SAM2完成最终分割。
少样本医学图像分割(FSMIS)虽取得显著进展,但现有方法多依赖稀疏标注中的语义对应关系,忽视了医学图像一个关键特性:解剖目标在不同患者和成像条件下具有可重复的高频形态特征(如边界几何与空间布局)。本文提出RAP框架,无需训练即可实现少样本医学图像分割。首先,利用DINOv3特征从档案库中检索形态匹配的支持样本,降低单一样本选择带来的脆弱性;其次,通过拟合边界感知的结构线索,将检索到的支持掩码适配到查询图像,生成在域偏移下仍保持解剖一致性的预分割掩码;最后,通过Voronoi划分采样正点、扇区采样生成负点,构建提示输入SAM2进行最终精修,全程无需微调。在多个医学分割基准上实验表明,RAP持续优于已有基线,达到当前最优性能。结果证明,显式结构拟合结合检索增强提示,为鲁棒的无训练少样本医学分割提供了一条简单高效的新路径。
原文摘要 · Abstract (English)
Few-shot medical image segmentation (FSMIS) has achieved notable progress, yet most existing methods mainly rely on semantic correspondences from scarce annotations while under-utilizing a key property of medical imagery: anatomical targets exhibit repeatable high-frequency morphology (e.g., boundary geometry and spatial layout) across patients and acquisitions. We propose RAP, a training-free framework that retrieves, adapts, and prompts Segment Anything Model 2 (SAM2) for FSMIS. First, RAP retrieves morphologically compatible supports from an archive using DINOv3 features to reduce brittleness in single-support choice. Second, it adapts the retrieved support mask to the query by fitting boundary-aware structural cues, yielding an anatomy-consistent pre-mask under domain shifts. Third, RAP converts the pre-mask into prompts by sampling positive points via Voronoi partitioning and negative points via sector-based sampling, and feeds them into SAM2 for final refinement without any fine-tuning. Extensive experiments on multiple medical segmentation benchmarks show that RAP consistently surpasses prior FSMIS baselines and achieves state-of-the-art performance. Overall, RAP demonstrates that explicit structural fitting combined with retrieval-augmented prompting offers a simple and effective route to robust training-free few-shot medical segmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。