arXiv:2507.16559cs.CV2025-07中稿 · the journal Medica…被引 6

构建多中心腹腔镜胆囊切除数据集,联合评估手术阶段、器械关键点与实例分割。

Comparative validation of surgical phase recognition, instrument keypoint estimation, and instrument instance segmentation in endoscopy: Results of the PhaKIR 2024 challenge

  • 构建包含13段完整手术视频的多中心数据集,统一标注三类任务。
  • 首次实现手术阶段与器械定位任务在同一批数据中的联合评估。
  • 适合从事手术视觉理解、机器人辅助手术研究的团队使用。

内窥镜视频中可靠识别和定位手术器械是计算机辅助和机器人辅助微创手术(RAMIS)广泛应用的基础,涵盖手术训练、技能评估和自主辅助等场景。然而,在真实条件下保持鲁棒性仍是重大挑战。引入手术上下文(如当前手术阶段)已成为提升鲁棒性和可解释性的有效策略。为此,我们在MICCAI 2024年端镜视觉(EndoVis)挑战赛中组织了“手术过程阶段、关键点与器械识别”(PhaKIR)子挑战。我们构建了一个新的多中心数据集,包含来自三家医疗机构的13段完整腹腔镜胆囊切除术视频,对三个相互关联的任务进行了统一标注:手术阶段识别、器械关键点估计和器械实例分割。该数据集支持在同一数据上联合研究器械定位与手术上下文,并能利用全过程的时间信息。我们依据BIAS指南报告结果与发现。PhaKIR子挑战为开发具有时间感知和上下文驱动能力的RAMIS方法提供了独特基准,并为未来手术场景理解研究提供了高质量资源。

原文摘要 · Abstract (English)

Reliable recognition and localization of surgical instruments in endoscopic video recordings are foundational for a wide range of applications in computer- and robot-assisted minimally invasive surgery (RAMIS), including surgical training, skill assessment, and autonomous assistance. However, robust performance under real-world conditions remains a significant challenge. Incorporating surgical context - such as the current procedural phase - has emerged as a promising strategy to improve robustness and interpretability. To address these challenges, we organized the Surgical Procedure Phase, Keypoint, and Instrument Recognition (PhaKIR) sub-challenge as part of the Endoscopic Vision (EndoVis) challenge at MICCAI 2024. We introduced a novel, multi-center dataset comprising thirteen full-length laparoscopic cholecystectomy videos collected from three distinct medical institutions, with unified annotations for three interrelated tasks: surgical phase recognition, instrument keypoint estimation, and instrument instance segmentation. Unlike existing datasets, ours enables joint investigation of instrument localization and procedural context within the same data while supporting the integration of temporal information across entire procedures. We report results and findings in accordance with the BIAS guidelines for biomedical image analysis challenges. The PhaKIR sub-challenge advances the field by providing a unique benchmark for developing temporally aware, context-driven methods in RAMIS and offers a high-quality resource to support future research in surgical scene understanding.

手术理解多任务学习医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。