arXiv:2504.15152cs.CVcs.AI2025-04被引 14

无需解剖标志点,实现术前3D模型与术中实时影像的精准配准。

Landmark-Free Preoperative-to-Intraoperative Registration in Laparoscopic Liver Resection

  • 采用自监督学习将3D-2D配准转为3D-3D,分步完成刚性与非刚性校正。
  • 在21名患者共346帧图像上实现高精度配准,优于传统方法。
  • 适合肝切除手术导航,助力外科医生精准定位肝脏结构。

通过将术前3D模型叠加到术中2D图像上,可帮助外科医生清晰感知肝脏空间解剖结构,提升手术成功率。现有方法依赖解剖标志点,存在标志定义模糊、难以高效匹配,以及术中视觉信息在形变建模中整合不足的问题。为此,本文提出一种无标志点的术前-术中配准框架 extit{OurModel},将传统3D-2D流程转换为3D-3D配准,并分解为刚性与非刚性子任务。首先使用特征解耦变压器学习鲁棒对应关系以恢复刚性变换;随后设计结构正则化形变网络,通过低秩变压器建模几何相似性,捕捉结构关联,调整术前模型以匹配术中肝脏表面。为验证性能,构建了包含21例患者肝切除视频的在体配准数据集 extit{P2I-LReg},含346个关键帧,提供肝脏全局视图、掩码标注及标定相机内参。在合成与真实数据集上的大量实验和用户研究均表明该方法具有显著优势及临床应用潜力。

原文摘要 · Abstract (English)

Liver registration by overlaying preoperative 3D models onto intraoperative 2D frames can assist surgeons in perceiving the spatial anatomy of the liver clearly for a higher surgical success rate. Existing registration methods rely heavily on anatomical landmark-based workflows, which encounter two major limitations: 1) ambiguous landmark definitions fail to provide efficient markers for registration; 2) insufficient integration of intraoperative liver visual information in shape deformation modeling. To address these challenges, in this paper, we propose a landmark-free preoperative-to-intraoperative registration framework utilizing effective self-supervised learning, termed \ourmodel. This framework transforms the conventional 3D-2D workflow into a 3D-3D registration pipeline, which is then decoupled into rigid and non-rigid registration subtasks. \ourmodel~first introduces a feature-disentangled transformer to learn robust correspondences for recovering rigid transformations. Further, a structure-regularized deformation network is designed to adjust the preoperative model to align with the intraoperative liver surface. This network captures structural correlations through geometry similarity modeling in a low-rank transformer network. To facilitate the validation of the registration performance, we also construct an in-vivo registration dataset containing liver resection videos of 21 patients, called \emph{P2I-LReg}, which contains 346 keyframes that provide a global view of the liver together with liver mask annotations and calibrated camera intrinsic parameters. Extensive experiments and user studies on both synthetic and in-vivo datasets demonstrate the superiority and potential clinical applicability of our method.

医学图像配准肝切除自监督

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。