arXiv:2502.06336cs.CVcs.AI2025-02被引 5

用Transformer提升软组织点云配准精度,应对形变大、噪声多等挑战

DefTransNet: A Transformer-based Method for Non-Rigid Point Cloud Registration in the Simulation of Soft Tissue Deformation

  • 基于Transformer设计端到端网络,融合全局与局部几何特征
  • 在4个数据集上优于现有方法,尤其在大形变和部分数据下表现优异
  • 适合医学影像配准、手术模拟等需要高精度变形建模的场景

软组织手术(如肿瘤切除)因组织形变难以准确判断其位置与形状。通过将组织表面表示为点云并应用非刚性点云配准(PCR)方法,可帮助医生在术前、术中及术后更好地理解形变。现有基于特征的非刚性PCR方法在噪声、离群点、部分数据和大形变等挑战下鲁棒性差,难以建立准确对应关系。尽管基于学习的PCR方法(尤其是Transformer架构)因注意力机制能捕捉点间交互而展现出潜力,但在复杂场景下仍受限。本文提出DefTransNet,一种新型端到端Transformer架构用于非刚性PCR。该方法通过输入源点云和目标点云,输出位移向量场,引入可学习变换矩阵以增强对仿射变换的鲁棒性,融合全局与局部几何信息,并利用Transformer捕捉点间的长程依赖。我们在ModelNet、SynBench、4DMatch和DeformedTissue四个数据集上验证方法,涵盖合成与真实数据,证明其具备良好泛化能力。实验结果表明,DefTransNet在多种严苛条件下均超越当前最优配准网络。代码与数据已公开。

原文摘要 · Abstract (English)

Soft-tissue surgeries, such as tumor resections, are complicated by tissue deformations that can obscure the accurate location and shape of tissues. By representing tissue surfaces as point clouds and applying non-rigid point cloud registration (PCR) methods, surgeons can better understand tissue deformations before, during, and after surgery. Existing non-rigid PCR methods, such as feature-based approaches, struggle with robustness against challenges like noise, outliers, partial data, and large deformations, making accurate point correspondence difficult. Although learning-based PCR methods, particularly Transformer-based approaches, have recently shown promise due to their attention mechanisms for capturing interactions, their robustness remains limited in challenging scenarios. In this paper, we present DefTransNet, a novel end-to-end Transformer-based architecture for non-rigid PCR. DefTransNet is designed to address the key challenges of deformable registration, including large deformations, outliers, noise, and partial data, by inputting source and target point clouds and outputting displacement vector fields. The proposed method incorporates a learnable transformation matrix to enhance robustness to affine transformations, integrates global and local geometric information, and captures long-range dependencies among points using Transformers. We validate our approach on four datasets: ModelNet, SynBench, 4DMatch, and DeformedTissue, using both synthetic and real-world data to demonstrate the generalization of our proposed method. Experimental results demonstrate that DefTransNet outperforms current state-of-the-art registration networks across various challenging conditions. Our code and data are publicly available.

点云配准Transformer软组织模拟医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。