通过隐式特征对应关系,提升腹腔镜肝脏手术中术前术后图像配准的精度与可解释性。
Preoperative-to-intraoperative Liver Registration for Laparoscopic Surgery via Latent-Grounded Correspondence Constraints
- 基于隐空间特征构建2D-3D关键点对应关系,增强配准可解释性。
- 在P2ILF数据集上,刚性与非刚性配准均优于现有方法。
- 适合需要高精度术中导航的肝外科医生和医学影像研究者。
在腹腔镜肝脏手术中,增强现实技术通过将术前CT/MRI生成的3D肝脏模型叠加到术中2D腹腔镜视图上,提升解剖引导效果。然而,现有配准方法缺乏对由隐式证据支持的可靠2D-3D几何对应关系的显式建模,导致解释性差且临床场景下配准不稳定。本文提出Land-Reg,一种以对应关系驱动的可变形配准框架,显式学习隐空间支撑的2D-3D关键点对应关系,作为跨模态对齐的可解释中间表示。针对刚性配准,引入跨模态隐空间对齐模块,将多模态特征映射至统一隐空间;进一步设计不确定性增强的重叠关键点检测器,结合相似性匹配,鲁棒估计显式2D-3D关键点对应。针对非刚性配准,提出新型形状约束监督策略,通过重投影一致性将形变锚定在匹配的关键点上,并引入局部等距正则化缓解固有的2D-3D深度模糊性,同时利用渲染掩码对齐保证全局形状一致性。在P2ILF数据集上的实验表明,该方法在刚性姿态估计与非刚性形变方面均具优越性能。代码将公开于https://github.com/cuiruize/Land-Reg。
原文摘要 · Abstract (English)
In laparoscopic liver surgery, augmented reality technology enhances intraoperative anatomical guidance by overlaying 3D liver models from preoperative CT/MRI onto laparoscopic 2D views. However, existing registration methods lack explicit modeling of reliable 2D-3D geometric correspondences supported by latent evidence, leading to limited interpretability and potentially unstable alignment in clinical scenarios. In this work, we introduce Land-Reg, a correspondence-driven deformable registration framework that explicitly learns latent-grounded 2D-3D landmark correspondences as an interpretable intermediate representation to bridge cross-modal alignment. For rigid registration, Land-Reg embraces a Cross-modal Latent Alignment module to map multi-modal features into a unified latent space. Further, an Uncertainty-enhanced Overlap Landmark Detector with similarity matching is proposed to robustly estimate explicit 2D-3D landmark correspondences. For non-rigid registration, we design a novel shape-constrained supervision strategy that anchors shape deformation to matched landmarks through reprojection consistency and incorporates local-isometric regularization to alleviate inherent 2D-3D depth ambiguity, while a rendered-mask alignment enforces global shape consistency. Experimental results on the P2ILF dataset demonstrate the superiority of our method on both rigid pose estimation and non-rigid deformation. Our code will be available at https://github.com/cuiruize/Land-Reg.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。