首个多中心腹腔镜手术数据集,支持阶段、关键点与器械识别联合分析。
Video Dataset for Surgical Phase, Keypoint, and Instrument Recognition in Laparoscopic Surgery (PhaKIR)
- 构建跨三中心的完整胆囊切除术视频数据集,含帧级标注。
- 提供48.6万帧阶段标签、1.9万帧关键点与分割标注,支持时序建模。
- 适合研究手术理解、器械追踪及多任务学习的团队使用。
机器人与计算机辅助微创手术(RAMIS)日益依赖计算机视觉技术实现器械识别与手术流程理解。但现有资源常局限于单一任务,忽略时间关联性,缺乏多中心差异。我们提出腹腔镜手术阶段、关键点与器械识别数据集(PhaKIR),包含三个医疗中心录制的8个完整胆囊切除术视频。数据集提供帧级标注:手术阶段识别(485,875帧)、器械关键点估计(19,435帧)、器械实例分割(19,435帧)。PhaKIR是目前已知首个同时提供阶段标签、器械姿态信息和像素级分割的多中心数据集,且因完整手术序列可用,支持时序上下文建模。该数据集作为MICCAI 2024年端镜视觉挑战赛(EndoVis Challenge)的一部分,用于基准测试手术场景理解方法,进一步验证其质量与适用性。数据集可通过Zenodo平台申请获取。
原文摘要 · Abstract (English)
Robotic- and computer-assisted minimally invasive surgery (RAMIS) is increasingly relying on computer vision methods for reliable instrument recognition and surgical workflow understanding. Developing such systems often requires large, well-annotated datasets, but existing resources often address isolated tasks, neglect temporal dependencies, or lack multi-center variability. We present the Surgical Procedure Phase, Keypoint, and Instrument Recognition (PhaKIR) dataset, comprising eight complete laparoscopic cholecystectomy videos recorded at three medical centers. The dataset provides frame-level annotations for three interconnected tasks: surgical phase recognition (485,875 frames), instrument keypoint estimation (19,435 frames), and instrument instance segmentation (19,435 frames). PhaKIR is, to our knowledge, the first multi-institutional dataset to jointly provide phase labels, instrument pose information, and pixel-accurate instrument segmentations, while also enabling the exploitation of temporal context since full surgical procedure sequences are available. It served as the basis for the PhaKIR Challenge as part of the Endoscopic Vision (EndoVis) Challenge at MICCAI 2024 to benchmark methods in surgical scene understanding, thereby further validating the dataset's quality and relevance. The dataset is publicly available upon request via the Zenodo platform.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。