arXiv:2409.02598cs.CVcs.AI2024-09被引 2

无需CAD模型,实现高精度3D手术器械实时跟踪。

SurgTrack: CAD-Free 3D Tracking of Real-world Surgical Instruments

  • 用符号距离场建模器械3D形状,免去依赖CAD模型。
  • 通过历史姿态优化,提升遮挡情况下的跟踪稳定性。
  • 适用于真实手术场景,适合医疗视觉导航研究者使用。

基于视觉的手术导航因其非侵入性、低成本和灵活性受到越来越多关注。其中,手术器械的跟踪是关键环节。相较于2D跟踪,3D跟踪在临床中价值更高,但面临纹理弱、遮挡严重以及缺乏用于3D配准的计算机辅助设计(CAD)模型等挑战。为此,我们提出SurgTrack,一种两阶段的无CAD 3D器械跟踪方法,适用于真实世界鲁棒应用。第一阶段采用器械符号距离场(SDF)建模,实现无CAD的3D配准,通过视频流与注册后的SDF模型匹配,获取器械在三维空间中的位置与姿态。第二阶段设计姿态图优化模块,利用姿态记忆池中的历史追踪结果进行优化,增强对遮挡的鲁棒性。此外,我们构建了Instrument3D数据集,全面评估手术器械的3D跟踪性能。大量实验验证了SurgTrack在精度和可扩展性上的优越性,显著优于现有最先进方法。代码与数据集已开源。

原文摘要 · Abstract (English)

Vision-based surgical navigation has received increasing attention due to its non-invasive, cost-effective, and flexible advantages. In particular, a critical element of the vision-based navigation system is tracking surgical instruments. Compared with 2D instrument tracking methods, 3D instrument tracking has broader value in clinical practice, but is also more challenging due to weak texture, occlusion, and lack of Computer-Aided Design (CAD) models for 3D registration. To solve these challenges, we propose the SurgTrack, a two-stage 3D instrument tracking method for CAD-free and robust real-world applications. In the first registration stage, we incorporate an Instrument Signed Distance Field (SDF) modeling the 3D representation of instruments, achieving CAD-freed 3D registration. Due to this, we can obtain the location and orientation of instruments in the 3D space by matching the video stream with the registered SDF model. In the second tracking stage, we devise a posture graph optimization module, leveraging the historical tracking results of the posture memory pool to optimize the tracking results and improve the occlusion robustness. Furthermore, we collect the Instrument3D dataset to comprehensively evaluate the 3D tracking of surgical instruments. The extensive experiments validate the superiority and scalability of our SurgTrack, by outperforming the state-of-the-arts with a remarkable improvement. The code and dataset are available at https://github.com/wenwucode/SurgTrack.

3D跟踪手术导航SDF医疗器械

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。