arXiv:2506.10344cs.CV2025-06被引 1

提出可直接在真实坐标系中匹配关键点的图像配准方法,避免重采样失真。

RealKeyMorph: Keypoints in Real-world Coordinates for Resolution-agnostic Image Registration

  • 在真实世界坐标系中输出关键点,无需对原始图像重采样。
  • 在腹部MRI和脑部3D数据上实现高精度配准,保持分辨率无关性。
  • 适合医学影像分析、多模态图像融合等需保留原始分辨率的场景。

许多真实应用场景需要配准空间分辨率不同的医学图像,这通常源于像素间距、切片厚度和视野等成像参数差异。然而,以往基于机器学习的配准方法均将图像重采样至固定分辨率,这可能导致插值引入伪影。为此,我们提出一种分辨率无关的图像配准方法 RealKeyMorph(RKM),它是 KeyMorph 框架的扩展。RKM 训练网络学习图像对之间的对应关键点,随后通过闭式匹配步骤推导出对齐变换。为避免重采样并直接处理原始数据,RKM 将关键点输出到扫描仪定义的真实世界坐标系。方法利用扫描仪生成的仿射矩阵(如 MRI 机器)将体素坐标映射到真实世界坐标。通过在训练中融入该转换,使提取的关键点具备分辨率无关特性。实验表明,RKM 在正交2D腹部MRI堆栈以及具有不同分辨率的脑部3D数据集上的配准任务中均表现出优越性能。

原文摘要 · Abstract (English)

Many real-world settings require registration of a pair of medical images that differ in spatial resolution, which may arise from differences in image acquisition parameters like pixel spacing, slice thickness, and field-of-view. However, all previous machine learning-based registration techniques resample images onto a fixed resolution. This is suboptimal because resampling can introduce artifacts due to interpolation. To address this, we present RealKeyMorph (RKM), a resolution-agnostic method for image registration. RKM is an extension of KeyMorph, a registration framework which works by training a network to learn corresponding keypoints for a given pair of images, after which a closed-form keypoint matching step is used to derive the transformation that aligns them. To avoid resampling and enable operating on the raw data, RKM outputs keypoints in real-world coordinates of the scanner. To do this, we leverage the affine matrix produced by the scanner (e.g., MRI machine) that encodes the mapping from voxel coordinates to real world coordinates. By transforming keypoints into real-world space and integrating this into the training process, RKM effectively enables the extracted keypoints to be resolution-agnostic. In our experiments, we demonstrate the advantages of RKM on the registration task for orthogonal 2D stacks of abdominal MRIs, as well as 3D volumes with varying resolutions in brain datasets.

图像配准医学影像关键点匹配分辨率无关

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。