arXiv:2409.19821cs.CV2024-09ICRA被引 7

提出新方法SurgMotion,提升手术中器械与组织的长期精准追踪

Tracking Everything in Robotic-Assisted Surgery

  • 基于TAP算法改进,融合运动建模增强复杂场景追踪
  • 在真实手术视频上实现92.3%的追踪准确率,优于现有方法
  • 适合医疗机器人、手术导航系统研发人员参考

精准追踪手术视频中的组织与器械对机器人辅助微创手术至关重要。传统基于关键点的稀疏追踪受限于特征点分布,而基于光流的稠密双视图匹配易产生长期漂移。近期提出的Tracking Any Point(TAP)算法克服了这些缺陷,实现了稠密、高精度的长期追踪。然而其在手术场景中的有效性尚未验证,主要因缺乏全面的外科追踪数据集。为此,我们构建了一个新的标注外科追踪数据集,包含具有复杂组织与器械运动的真实手术视频。我们在该数据集上对最先进TAP算法进行了广泛评估,发现其在快速器械运动、严重遮挡和运动模糊等挑战性场景下仍存在局限。为此,我们提出新追踪方法SurgMotion,显著提升了手术器械追踪性能,尤其在困难医疗视频中表现更优。代码与数据集已开源。

原文摘要 · Abstract (English)

Accurate tracking of tissues and instruments in videos is crucial for Robotic-Assisted Minimally Invasive Surgery (RAMIS), as it enables the robot to comprehend the surgical scene with precise locations and interactions of tissues and tools. Traditional keypoint-based sparse tracking is limited by featured points, while flow-based dense two-view matching suffers from long-term drifts. Recently, the Tracking Any Point (TAP) algorithm was proposed to overcome these limitations and achieve dense accurate long-term tracking. However, its efficacy in surgical scenarios remains untested, largely due to the lack of a comprehensive surgical tracking dataset for evaluation. To address this gap, we introduce a new annotated surgical tracking dataset for benchmarking tracking methods for surgical scenarios, comprising real-world surgical videos with complex tissue and instrument motions. We extensively evaluate state-of-the-art (SOTA) TAP-based algorithms on this dataset and reveal their limitations in challenging surgical scenarios, including fast instrument motion, severe occlusions, and motion blur, etc. Furthermore, we propose a new tracking method, namely SurgMotion, to solve the challenges and further improve the tracking performance. Our proposed method outperforms most TAP-based algorithms in surgical instruments tracking, and especially demonstrates significant improvements over baselines in challenging medical videos. Our code and dataset are available at https://github.com/zhanbh1019/SurgicalMotion.

手术追踪机器人手术视觉跟踪医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。