实时无对应点3D-2D配准新方法,提升手术导航精度
DynaWeightPnP: Toward global real-time 3D-2D solver in PnP without correspondences
- 基于RKHS和迭代加权最小二乘法,解决大到小形状匹配难题
- 实现60Hz实时处理(无后优化),31Hz(含后优化),精度媲美现有方法
- 揭示旋转与平移的数值模糊性,适合医疗机器人等实时场景
本文针对无对应点的透视n点(PnP)问题,提出在实时条件下估计最优姿态以对齐3D与2D形状。现有方法难以兼顾实时性与准确性。本研究聚焦3D-2D几何形状配准任务,引入再生核希尔伯特空间(RKHS)解决“大到小”匹配问题,采用迭代重加权最小二乘法高效求解。同时,发现无对应点PnP中存在旋转与平移间的数值模糊性。为此提出DynaWeightPnP,引入动态加权子问题与替代搜索算法,提升姿态估计与对齐精度。在血管中心线配准任务(用于血管内影像引导介入手术,EIGIs)上测试,结果表明该算法在现代单核CPU上可实现60 Hz(无后优化)和31 Hz(含后优化)的处理速率,精度与现有方法相当。验证了其在机器人导航等未来应用中的适用性。
原文摘要 · Abstract (English)
This paper addresses a special Perspective-n-Point (PnP) problem: estimating the optimal pose to align 3D and 2D shapes in real-time without correspondences, termed as correspondence-free PnP. While several studies have focused on 3D and 2D shape registration, achieving both real-time and accurate performance remains challenging. This study specifically targets the 3D-2D geometric shape registration tasks, applying the recently developed Reproducing Kernel Hilbert Space (RKHS) to address the "big-to-small" issue. An iterative reweighted least squares method is employed to solve the RKHS-based formulation efficiently. Moreover, our work identifies a unique and interesting observability issue in correspondence-free PnP: the numerical ambiguity between rotation and translation. To address this, we proposed DynaWeightPnP, introducing a dynamic weighting sub-problem and an alternative searching algorithm designed to enhance pose estimation and alignment accuracy. Experiments were conducted on a typical case, that is, a 3D-2D vascular centerline registration task within Endovascular Image-Guided Interventions (EIGIs). Results demonstrated that the proposed algorithm achieves registration processing rates of 60 Hz (without post-refinement) and 31 Hz (with post-refinement) on modern single-core CPUs, with competitive accuracy comparable to existing methods. These results underscore the suitability of DynaWeightPnP for future robot navigation tasks like EIGIs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。