arXiv:2506.01130cs.CV2025-06被引 4

构建首个大规模精准标注的手术三元组检测数据集,推动手术分析从分类迈向精确定位。

ProstaTD: Bridging Surgical Triplet from Classification to Fully Supervised Detection

  • 构建多中心机器人前列腺切除术数据集,含高精度时空标注的三元组实例
  • 涵盖71,775帧视频与196,490个标注实例,覆盖21例手术及多样化临床场景
  • 提供专用标注工具与评估套件,支持可复现的手术检测研究

手术三元组检测是手术视频分析的关键任务。然而,现有数据集如CholecT50缺乏精确的空间边界框标注,导致图像级分类难以满足实际应用需求。边界框标注对提供空间上下文、提升模型泛化能力至关重要。为此,我们提出ProstaTD,一个大规模、多机构的手术三元组检测数据集,源自技术难度高的机器人辅助前列腺切除术。ProstaTD包含临床定义的时间边界和每个结构化三元组活动的高精度边界框标注。数据集共包含71,775帧视频和196,490个标注的三元组实例,来自21例跨机构手术,反映了广泛的手术实践和术中条件。标注过程在严格医疗监督下完成,由超过60名参与者(包括执业外科医生和医学训练标注员)通过多轮迭代标注与验证完成。为促进未来通用手术标注,我们开发了两款定制标注工具以提升效率与可扩展性,并构建了标准化的三元组检测评估工具包,实现跨研究的可复现评估。ProstaTD是迄今最大且最多样化的手术三元组数据集,推动领域从简单分类迈向具有精确时空边界的完整检测,为公平基准测试提供了坚实基础。

原文摘要 · Abstract (English)

Surgical triplet detection is a critical task in surgical video analysis. However, existing datasets like CholecT50 lack precise spatial bounding box annotations, rendering triplet classification at the image level insufficient for practical applications. The inclusion of bounding box annotations is essential to make this task meaningful, as they provide the spatial context necessary for accurate analysis and improved model generalizability. To address these shortcomings, we introduce ProstaTD, a large-scale, multi-institutional dataset for surgical triplet detection, developed from the technically demanding domain of robot-assisted prostatectomy. ProstaTD offers clinically defined temporal boundaries and high-precision bounding box annotations for each structured triplet activity. The dataset comprises 71,775 video frames and 196,490 annotated triplet instances, collected from 21 surgeries performed across multiple institutions, reflecting a broad range of surgical practices and intraoperative conditions. The annotation process was conducted under rigorous medical supervision and involved more than 60 contributors, including practicing surgeons and medically trained annotators, through multiple iterative phases of labeling and verification. To further facilitate future general-purpose surgical annotation, we developed two tailored labeling tools to improve efficiency and scalability in our annotation workflows. In addition, we created a surgical triplet detection evaluation toolkit that enables standardized and reproducible performance assessment across studies. ProstaTD is the largest and most diverse surgical triplet dataset to date, moving the field from simple classification to full detection with precise spatial and temporal boundaries and thereby providing a robust foundation for fair benchmarking.

手术分析三元组检测数据集机器人手术

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。