arXiv:2410.14083cs.CV2024-10被引 7

用区域对应关系实现无需训练的医学图像配准,效果优于传统方法。

SAMReg: SAM-enabled Image Registration with ROI-based Correspondence

  • 基于感兴趣区(ROI)构建空间对应关系,连接分割与配准任务。
  • 在心脏磁共振、前列腺磁共振等5个真实场景中,Dice和配准误差均更优。
  • 基于SAM模型,无需训练或提示工程,适合临床快速部署。

本文提出一种基于配对感兴趣区(ROIs)的空间对应表示方法,用于医学图像配准。相较于基于采样位移或空间变换函数的替代方法,该方法在临床应用中具有明显优势,尤其体现在学习型图像配准与分割之间的清晰关联上,从而启发了两种利用(预)训练分割网络的配准策略。基于分割基础模型Segment Anything Model(SAM),我们开发了无需训练(或训练数据)、无梯度微调、无需提示工程的新配准算法SAMReg。所提方法在五个真实应用场景中进行了评估,包括心脏磁共振与肺部CT的同体配准、前列腺磁共振与视网膜成像的跨体配准,以及航空图像的非临床配准。在包括Dice系数和目标配准误差在内的多项指标上,该方法显著优于基于强度的迭代算法和预测位移场的学习型网络,并在弱监督配准方法中表现竞争力,后者依赖完全分割的训练数据。开源代码与示例已发布于:https://github.com/sqhuang0103/SAMReg.git。

原文摘要 · Abstract (English)

This paper describes a new spatial correspondence representation based on paired regions-of-interest (ROIs), for medical image registration. The distinct properties of the proposed ROI-based correspondence are discussed, in the context of potential benefits in clinical applications following image registration, compared with alternative correspondence-representing approaches, such as those based on sampled displacements and spatial transformation functions. These benefits include a clear connection between learning-based image registration and segmentation, which in turn motivates two cases of image registration approaches using (pre-)trained segmentation networks. Based on the segment anything model (SAM), a vision foundation model for segmentation, we develop a new registration algorithm SAMReg, which does not require any training (or training data), gradient-based fine-tuning or prompt engineering. The proposed SAMReg models are evaluated across five real-world applications, including intra-subject registration tasks with cardiac MR and lung CT, challenging inter-subject registration scenarios with prostate MR and retinal imaging, and an additional evaluation with a non-clinical example with aerial image registration. The proposed methods outperform both intensity-based iterative algorithms and DDF-predicting learning-based networks across tested metrics including Dice and target registration errors on anatomical structures, and further demonstrates competitive performance compared to weakly-supervised registration approaches that rely on fully-segmented training data. Open source code and examples are available at: https://github.com/sqhuang0103/SAMReg.git.

图像配准医学影像SAM无监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。