arXiv:2507.20337cs.CV2025-07

用术前到术中点云直接预测肝脏变形,提升手术导航精度。

PIVOTS: Aligning unseen Structures using Preoperative to Intraoperative Volume-To-Surface Registration for Liver Navigation

  • 直接输入点云,通过多尺度特征与变形感知注意力模块预测变形。
  • 在含噪、大变形、视野受限条件下,注册误差低于基准方法18.7%。
  • 适合需要高精度肝手术导航的临床研究与算法开发者。

非刚性配准对于增强现实引导的腹腔镜肝手术至关重要,可通过融合术前信息(如肿瘤位置和血管结构)来扩展有限的术中视野,从而提升手术导航能力。其前提是准确预测术中肝脏形变,但这一任务极具挑战性,原因包括气腹、呼吸运动和器械交互带来的大形变,以及术中数据噪声、视野遮挡和相机移动受限等问题。为此,我们提出PIVOTS,一种基于术前到术中体到表面配准的神经网络,直接以点云为输入进行形变预测。几何特征提取编码器支持多分辨率特征提取,解码器包含新颖的变形感知交叉注意力模块,实现术前与术中信息的交互,并精确预测多层次位移。模型在基于生物力学仿真管道生成的合成数据上训练,并在合成与真实数据集上验证性能。结果表明,相比基线方法,本方法在噪声、大形变及不同可视程度条件下均表现出更优的配准性能。我们公开了训练与测试集作为评估基准,呼吁对肝注册方法采用体到表面数据进行公平比较。代码与数据集已发布于https://github.com/pengliu-nct/PIVOTS。

原文摘要 · Abstract (English)

Non-rigid registration is essential for Augmented Reality guided laparoscopic liver surgery by fusing preoperative information, such as tumor location and vascular structures, into the limited intraoperative view, thereby enhancing surgical navigation. A prerequisite is the accurate prediction of intraoperative liver deformation which remains highly challenging due to factors such as large deformation caused by pneumoperitoneum, respiration and tool interaction as well as noisy intraoperative data, and limited field of view due to occlusion and constrained camera movement. To address these challenges, we introduce PIVOTS, a Preoperative to Intraoperative VOlume-To-Surface registration neural network that directly takes point clouds as input for deformation prediction. The geometric feature extraction encoder allows multi-resolution feature extraction, and the decoder, comprising novel deformation aware cross attention modules, enables pre- and intraoperative information interaction and accurate multi-level displacement prediction. We train the neural network on synthetic data simulated from a biomechanical simulation pipeline and validate its performance on both synthetic and real datasets. Results demonstrate superior registration performance of our method compared to baseline methods, exhibiting strong robustness against high amounts of noise, large deformation, and various levels of intraoperative visibility. We publish the training and test sets as evaluation benchmarks and call for a fair comparison of liver registration methods with volume-to-surface data. Code and datasets are available here https://github.com/pengliu-nct/PIVOTS.

医学影像非刚性配准肝脏导航点云处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。