arXiv:2508.01697cs.CV2025-08

不用训练,用提示词直接找图像对应区域,提升医学影像配准精度。

Register Anything: Estimating "Corresponding Prompts" for Segment Anything Model

  • 通过反向提示词生成技术,一键匹配两图中的对应区域。
  • 在5个医学与遥感数据集上,配准误差低于传统方法,媲美有标注训练模型。
  • 适合无需标注数据的医疗影像配准场景,尤其适合快速部署。

图像配准的核心挑战在于像素/体素级或区域级对应关系的建立。传统方法分两步:先分割感兴趣区域(ROIs),再进行区域匹配。本文提出一种无需训练的新方法 PromptReg,将该过程简化为一步:直接“搜索对应提示词”。首先定义“对应提示问题”——为图像X中的任意视觉提示X,寻找图像Y中能生成对应区域的提示Y。其次提出“逆提示”解法,将提示X逆向映射至图像Y的提示空间,生成主提示和可选辅助提示。最后设计新算法,在提示和空间维度上对逆提示进行边缘化,实现多对对应区域的识别。在5个应用中测试:3D前列腺MRI、3D腹部MRI、3D肺部CT、2D病理切片及2D航拍图像。基于Dice分数和目标配准误差等指标,所提方法优于基于强度的迭代算法和学习型变形场预测网络,甚至达到弱监督方法性能,而后者需全分割训练数据。

原文摘要 · Abstract (English)

Establishing pixel/voxel-level or region-level correspondences is the core challenge in image registration. The latter, also known as region-based correspondence representation, leverages paired regions of interest (ROIs) to enable regional matching while preserving fine-grained capability at pixel/voxel level. Traditionally, this representation is implemented via two steps: segmenting ROIs in each image then matching them between the two images. In this paper, we simplify this into one step by directly "searching for corresponding prompts", using extensively pre-trained segmentation models (e.g., SAM) for a training-free registration approach, PromptReg. Firstly, we introduce the "corresponding prompt problem", which aims to identify a corresponding Prompt Y in Image Y for any given visual Prompt X in Image X, such that the two respectively prompt-conditioned segmentations are a pair of corresponding ROIs from the two images. Secondly, we present an "inverse prompt" solution that generates primary and optionally auxiliary prompts, inverting Prompt X into the prompt space of Image Y. Thirdly, we propose a novel registration algorithm that identifies multiple paired corresponding ROIs by marginalizing the inverted Prompt X across both prompt and spatial dimensions. Comprehensive experiments are conducted on five applications of registering 3D prostate MR, 3D abdomen MR, 3D lung CT, 2D histopathology and, as a non-medical example, 2D aerial images. Based on metrics including Dice and target registration errors on anatomical structures, the proposed registration outperforms both intensity-based iterative algorithms and learning-based DDF-predicting networks, even yielding competitive performance with weakly-supervised approaches that require fully-segmented training data.

图像配准提示词医学影像零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。