arXiv:2410.18683cs.CVcs.LG2024-10被引 5

无需解剖先验,单张2D影像可精准配准到3D体积数据中

Rigid Single-Slice-in-Volume registration via rotation-equivariant 2D/3D feature matching

  • 用旋转等变卷积提取2D/3D特征,解决维度差异问题
  • 在肺癌和脑部影像数据上实现<2°中位角误差,匹配准确率89%
  • 适合无解剖标志物的医学图像配准,如肿瘤影像

2D到3D配准在诊断、手术导航、机器人自主系统与增强现实等任务中至关重要。在医学影像中,目标是将单张2D图像定位到3D体数据中。现有刚性单切片配准方法受限于姿态初始化、相邻切片堆叠或可靠解剖标志物的要求。本文提出一种自监督2D/3D配准方法,可将单张2D切片与对应3D体积数据进行匹配,适用于无解剖先验的图像(如肿瘤影像)。该方法通过群等变卷积网络处理维度差异,建立2D平面内与3D平面外旋转等变特征间的对应关系。特征从2D查询切片提取,并与3D对应特征对齐。实验在NSCLC-Radiomics CT和KIRBY21 MRI数据集上验证,结果表明该方法具有强鲁棒性:绝对中位角误差小于2度,3像素容忍度下平均匹配特征准确率达89%。

原文摘要 · Abstract (English)

2D to 3D registration is essential in tasks such as diagnosis, surgical navigation, environmental understanding, navigation in robotics, autonomous systems, or augmented reality. In medical imaging, the aim is often to place a 2D image in a 3D volumetric observation to w. Current approaches for rigid single slice in volume registration are limited by requirements such as pose initialization, stacks of adjacent slices, or reliable anatomical landmarks. Here, we propose a self-supervised 2D/3D registration approach to match a single 2D slice to the corresponding 3D volume. The method works in data without anatomical priors such as images of tumors. It addresses the dimensionality disparity and establishes correspondences between 2D in-plane and 3D out-of-plane rotation-equivariant features by using group equivariant CNNs. These rotation-equivariant features are extracted from the 2D query slice and aligned with their 3D counterparts. Results demonstrate the robustness of the proposed slice-in-volume registration on the NSCLC-Radiomics CT and KIRBY21 MRI datasets, attaining an absolute median angle error of less than 2 degrees and a mean-matching feature accuracy of 89% at a tolerance of 3 pixels.

医学影像图像配准旋转等变自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。