构建首个融合骨骼姿态与实例分割的腹腔镜工具数据集,提升标注效率。
ROBUST-MIPS: A Combined Skeletal Pose and Instance Segmentation Dataset for Laparoscopic Surgical Instruments
- 提出骨骼姿态标注新方式,兼顾信息量与标注便捷性。
- 在基准测试中,姿态估计方法达到高精度,验证其有效性。
- 开源数据集、模型与标注工具,助力手术辅助研究落地。
手术器械定位是计算机辅助介入技术的基础。现有研究多依赖深度学习进行分割任务,但性能受限于多样标注数据的缺乏。本文认为骨骼姿态标注更高效,在语义丰富性与标注难度间取得平衡,可加速标注数据增长。为此,我们基于现有ROBUST-MIS数据集,构建了全新的ROBUST-MIPS数据集,联合包含工具姿态与实例分割标注。该数据集支持两种标注方式的联合研究与下游任务的直接对比。为验证姿态标注的有效性,我们采用主流姿态估计方法建立简单基准,获得高质量结果。同时,随数据集发布基准模型与定制化工具姿态标注软件,降低使用门槛。
原文摘要 · Abstract (English)
Localisation of surgical tools constitutes a foundational building block for computer-assisted interventional technologies. Works in this field typically focus on training deep learning models to perform segmentation tasks. Performance of learning-based approaches is limited by the availability of diverse annotated data. We argue that skeletal pose annotations are a more efficient annotation approach for surgical tools, striking a balance between richness of semantic information and ease of annotation, thus allowing for accelerated growth of available annotated data. To encourage adoption of this annotation style, we present, ROBUST-MIPS, a combined tool pose and tool instance segmentation dataset derived from the existing ROBUST-MIS dataset. Our enriched dataset facilitates the joint study of these two annotation styles and allow head-to-head comparison on various downstream tasks. To demonstrate the adequacy of pose annotations for surgical tool localisation, we set up a simple benchmark using popular pose estimation methods and observe high-quality results. To ease adoption, together with the dataset, we release our benchmark models and custom tool pose annotation software.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。