arXiv:2409.18457cs.CVcs.RO2024-09被引 2

实时无对应点3D-2D配准新方法,提升手术导航精度

DynaWeightPnP: Toward global real-time 3D-2D solver in PnP without correspondences

  • 基于RKHS和迭代加权最小二乘法,解决大到小形状匹配难题
  • 实现60Hz实时处理(无后优化),31Hz(含后优化),精度媲美现有方法
  • 揭示旋转与平移的数值模糊性,适合医疗机器人等实时场景

本文针对无对应点的透视n点(PnP)问题,提出在实时条件下估计最优姿态以对齐3D与2D形状。现有方法难以兼顾实时性与准确性。本研究聚焦3D-2D几何形状配准任务,引入再生核希尔伯特空间(RKHS)解决“大到小”匹配问题,采用迭代重加权最小二乘法高效求解。同时,发现无对应点PnP中存在旋转与平移间的数值模糊性。为此提出DynaWeightPnP,引入动态加权子问题与替代搜索算法,提升姿态估计与对齐精度。在血管中心线配准任务(用于血管内影像引导介入手术,EIGIs)上测试,结果表明该算法在现代单核CPU上可实现60 Hz(无后优化)和31 Hz(含后优化)的处理速率,精度与现有方法相当。验证了其在机器人导航等未来应用中的适用性。

原文摘要 · Abstract (English)

This paper addresses a special Perspective-n-Point (PnP) problem: estimating the optimal pose to align 3D and 2D shapes in real-time without correspondences, termed as correspondence-free PnP. While several studies have focused on 3D and 2D shape registration, achieving both real-time and accurate performance remains challenging. This study specifically targets the 3D-2D geometric shape registration tasks, applying the recently developed Reproducing Kernel Hilbert Space (RKHS) to address the "big-to-small" issue. An iterative reweighted least squares method is employed to solve the RKHS-based formulation efficiently. Moreover, our work identifies a unique and interesting observability issue in correspondence-free PnP: the numerical ambiguity between rotation and translation. To address this, we proposed DynaWeightPnP, introducing a dynamic weighting sub-problem and an alternative searching algorithm designed to enhance pose estimation and alignment accuracy. Experiments were conducted on a typical case, that is, a 3D-2D vascular centerline registration task within Endovascular Image-Guided Interventions (EIGIs). Results demonstrated that the proposed algorithm achieves registration processing rates of 60 Hz (without post-refinement) and 31 Hz (with post-refinement) on modern single-core CPUs, with competitive accuracy comparable to existing methods. These results underscore the suitability of DynaWeightPnP for future robot navigation tasks like EIGIs.

3D-2D配准实时计算医疗导航无对应点

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。