发布首个外科机器人器械位姿估计基准数据集,推动无标记手术追踪技术发展。
SurgRIPE challenge: Benchmark of Surgical Robot Instrument Pose Estimation
- 构建真实手术视频与精确器械位姿匹配的数据集,支持深度学习训练。
- 挑战赛催生多个高精度、强鲁棒性算法,显著优于现有方法。
- 适合医疗影像、机器人手术和计算机视觉研究者参考使用。
精准的器械位姿估计是实现机器人手术自动化的关键步骤,有助于实现自主手术任务执行。基于视觉的器械位姿估计方法为工具追踪提供了实用途径,但通常需在器械上附加标记。近年来,越来越多研究聚焦于基于深度学习的无标记方法。然而,获取用于深度学习训练的真实手术数据及对应的真实位姿标注仍具挑战性。为此,我们在2023年第二十六届国际医学图像计算与计算机辅助介入会议(MICCAI)上推出了外科机器人器械位姿估计(SurgRIPE)挑战赛。该挑战旨在:(1) 向外科视觉领域提供带有真实位姿标注的逼真手术视频数据;(2) 建立无标记位姿估计方法的评估基准。挑战赛促成了多个新型算法的开发,展现出比现有方法更高的准确性和鲁棒性。对SurgRIPE数据集的性能评估表明,这些先进算法具备集成至机器人手术系统中的潜力,为更精确、更自主的手术操作铺平道路。SurgRIPE挑战赛成功建立了该领域的全新基准,推动了后续研究与技术发展。
原文摘要 · Abstract (English)
Accurate instrument pose estimation is a crucial step towards the future of robotic surgery, enabling applications such as autonomous surgical task execution. Vision-based methods for surgical instrument pose estimation provide a practical approach to tool tracking, but they often require markers to be attached to the instruments. Recently, more research has focused on the development of marker-less methods based on deep learning. However, acquiring realistic surgical data, with ground truth instrument poses, required for deep learning training, is challenging. To address the issues in surgical instrument pose estimation, we introduce the Surgical Robot Instrument Pose Estimation (SurgRIPE) challenge, hosted at the 26th International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI) in 2023. The objectives of this challenge are: (1) to provide the surgical vision community with realistic surgical video data paired with ground truth instrument poses, and (2) to establish a benchmark for evaluating markerless pose estimation methods. The challenge led to the development of several novel algorithms that showcased improved accuracy and robustness over existing methods. The performance evaluation study on the SurgRIPE dataset highlights the potential of these advanced algorithms to be integrated into robotic surgery systems, paving the way for more precise and autonomous surgical procedures. The SurgRIPE challenge has successfully established a new benchmark for the field, encouraging further research and development in surgical robot instrument pose estimation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。