arXiv:2501.09209cs.CV2025-01被引 8

发布大型外科手术视频数据集,推动医疗AI研究

Surgical Visual Understanding (SurgVU) Dataset

  • 收集100+小时手术视频,标注工具、动作等多维度信息
  • 支持器械检测、视觉问答等10余项临床任务研究
  • 适合医疗视觉、机器人手术方向研究者使用

得益于机器学习的进展和机器人辅助手术中可获取的大规模数据,外科数据科学正迎来基础性研究的良机。我们提出一个大规模外科手术视频及其配套标注数据集,用于该领域的研究。文中描述了数据采集方式及若干独特属性,并列举了多个典型应用场景。尽管该数据集最初为特定科学挑战设计(详见附带论文),但其通用性足以支持广泛的机器学习研究。我们期望该数据集能向更广泛的机器学习社区展示外科数据科学中的挑战性问题,并成为未来研究的重要基准。视频数据可通过 https://storage.googleapis.com/isi-surgvu/surgvu24_videos_only.zip 下载,标签文件位于 https://storage.googleapis.com/isi-surgvu/surgvu24_labels_updated_v2.zip,工具检测任务的验证集为 https://storage.googleapis.com/isi-surgvu/cat1_test_set_public.zip,手术视觉问答样例数据集为 https://storage.googleapis.com/isi-surgvu/SURGVU25_cat_2_sample_set_public.zip。

原文摘要 · Abstract (English)

Owing to recent advances in machine learning and the ability to harvest large amounts of data during robotic-assisted surgeries, surgical data science is ripe for foundational work. We present a large dataset of surgical videos and their accompanying labels for this purpose. We describe how the data was collected and some of its unique attributes. Multiple example problems are outlined. Although the dataset was curated for a particular set of scientific challenges (in an accompanying paper), it is general enough to be used for a broad range machine learning questions. Our hope is that this dataset exposes the larger machine learning community to the challenging problems within surgical data science, and becomes a touch-stone for future research. The videos are available at https://storage.googleapis.com/isi-surgvu/surgvu24_videos_only.zip, the labels at https://storage.googleapis.com/isi-surgvu/surgvu24_labels_updated_v2.zip, a validation set for tool detection problem at https://storage.googleapis.com/isi-surgvu/cat1_test_set_public.zip, and a sample set of question & answer pairs dataset for surgical visual question answering at https://storage.googleapis.com/isi-surgvu/SURGVU25_cat_2_sample_set_public.zip.

医学影像视频理解数据集手术机器人

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。