arXiv:2605.22200cs.CVcs.AI2026-05

首个开放手术缝合技能视觉评估挑战,推动自动化训练评价发展

OSS: Open Suturing Skills Vision-Based Assessment Challenge 2024-2025

论文配图:OSS: Open Suturing Skills Vision-Based Assessment Challenge 2024-2025
图 1 · 摘自论文原文
  • 用静态摄像头采集干实验环境下的缝合视频与器械轨迹数据
  • 多模型对比显示通用时空模型表现最优,但精细评分仍困难
  • 适合研究手术动作分析、医疗视觉评估的学者与开发者

通过高效培训实现高水平外科技能对患者预后至关重要。基于数据的自动化技能评估具有显著潜力,可提升外科训练质量。尽管机器学习方法在微创手术中日益普及,但在开放手术中的应用仍有限。本文介绍专为开放手术设计的MICCAI挑战赛结果,旨在基准化并推进视觉驱动的技能评估技术。该挑战赛数据集包含在干实验环境下,使用固定式GoPro相机录制的开放缝合训练视频,并附带器械轨迹信息。挑战赛连续两年举办,分别包含两项和三项独立任务:(1)将技能水平分为四类;(2)预测八项指标的客观结构化技术评估(OSATS)得分;(3)追踪双手与手术工具。参赛者提交了多种解决方案,包括基于深度学习的视频模型、基于追踪的方法以及混合方案。通用时空视频模型表现最佳,但概念各异的方法若执行得当亦能达到竞争力。精细的OSATS评分仍具挑战性,但增加训练数据可显著提升性能。由于频繁遮挡和器械出框,关键点追踪困难,限制了运动分析的应用。本工作为开放手术技能评估提供了创新且多样化的基准,揭示了视频评估的潜力与当前局限,指明了迈向临床影响的关键方向。

原文摘要 · Abstract (English)

Achieving high levels of surgical skill through effective training is essential for optimal patient outcomes. Automated, data-driven skill assessment holds significant potential to improve surgical training. While machine learning-based methods are increasingly popular for assessing skills in minimally invasive surgery, their application to open surgery remains limited. We present the results of a dedicated MICCAI challenge designed to benchmark and advance vision-based skill assessment in open surgery. The challenge dataset comprises videos of an open suturing training task recorded with a static GoPro camera in a dry-lab setting, with instrument trajectories available in addition to the primary video modality. The OSS Challenge was hosted over two consecutive years, comprising two and three independent tasks, respectively: (1) classifying skill level into four classes, (2) predicting the full Objective Structured Assessment of Technical Skills across eight categories, and (3) tracking hands and surgical tools. Participants submitted diverse solutions including deep learning-based video models, tracking-driven methods, and hybrid approaches. General-purpose spatiotemporal video models consistently achieved the strongest performance, though conceptually diverse approaches reached competitive levels when well-executed. Predicting fine-grained OSATS scores remains challenging but benefits substantially from increased training data. Keypoint tracking proves difficult given frequent occlusions and out-of-frame instances, limiting current applicability for motion-based skill analysis. This work benchmarks innovative and diverse solutions for surgical skill assessment, highlighting both the promise and current limitations of video-based evaluation in open surgery and identifying critical directions for advancing automated skill assessment toward clinical impact.

手术评估视觉分析干实验技能量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。