无需有限元模型,结合深度信息实现肝癌手术导航的精准3D-2D配准
Depth Augmented and FE Free 3D/2D Liver Registration for Laparoscopic Liver AR
- 用多类别轮廓与单目深度联合优化刚性姿态,提升初始配准鲁棒性
- 基于非刚性ICP构建患者特异性形变模型,均方目标配准误差达14.73mm
- 适合临床手术增强现实场景,尤其在视野受限时表现稳定
腹腔镜肝手术中的增强现实导航需要将术前3D模型与术中2D视频精确配准,但受部分遮挡、反光和组织形变影响仍具挑战。现有方法常依赖轮廓驱动的刚性初始化与有限元(FE)模型进行非刚性配准,增加建模复杂度。本文提出一种深度增强、无需有限元的3D-2D配准流程:刚性对齐阶段,通过改进FoundationPose中的RefineNet模块,结合多类别轮廓图与单目深度实现相对位姿精修;非刚性对齐阶段,基于非刚性ICP对应关系构建患者特异性统计形变模型,并采用粗到精的L-BFGS-B策略优化姿态与形状参数。在公开临床腹腔镜肝数据集上,该方法在人工轮廓设定条件下实现14.73mm的平均目标配准误差(TRE)。消融实验表明,单目深度显著提升刚性初始化性能;肿瘤定位分析显示,表面对齐优并不意味着目标定位误差低。在无真值的外部数据集上,方法生成了视觉合理的叠加结果,验证其有效性。结果表明,深度增强的姿态精修与无有限元的统计形变建模为可控环境下的肝手术3D-2D配准提供了可行替代方案。
原文摘要 · Abstract (English)
Augmented reality (AR) guidance in laparoscopic liver surgery requires accurate registration of preoperative 3D models to intraoperative 2D video, but remains challenging due to partial visibility, specularities, and tissue deformation. Existing methods often rely on contour-based rigid initialization and finite-element (FE) models for deformable registration, increasing modeling and engineering complexity. We present a depth-augmented, FE-free 3D--2D registration pipeline that combines robust rigid initialization with patient-specific non-rigid refinement. For rigid alignment, we adapt the RefineNet module of FoundationPose to laparoscopic liver scenes by using multi-class contour maps and monocular depth for relative pose refinement. For deformable alignment, we construct a patient-specific statistical deformation model from non-rigid ICP (NICP) correspondences and optimize pose and shape parameters using a coarse-to-fine L-BFGS-B strategy. On a public clinical laparoscopic liver dataset, the proposed method achieves a mean target registration error (TRE) of 14.73\,mm under a controlled manual-contour setting designed to isolate registration performance. Ablation studies show that monocular depth improves rigid initialization over contour-only inputs, while tumor-mapping analysis indicates that good surface alignment does not necessarily translate into lower target localization error. On an external dataset without ground truth, the method produces visually plausible overlays for qualitative assessment. These results suggest that depth-augmented pose refinement and FE-free statistical deformation modeling provide a promising alternative to FE-based pipelines for controlled 3D--2D liver registration in surgical AR.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。