用少量标注数据评估手术技能,关键在选对预训练数据。
Exploring Pre-training Across Domains for Few-Shot Surgical Skill Assessment
- 将手术技能评估设为少样本任务,测试不同预训练策略效果。
- 在1-5样本设置下准确率分别达60.16%、66.03%、73.65%。
- 小而相关的预训练数据比大而无关的更有效,适合医疗视觉研究者。
自动化手术技能评估(SSA)是手术计算机视觉的核心任务。由于技能标注稀缺且需专家共识,构建稳健的SSA模型极具挑战。少样本学习(FSL)提供了低监督下的可扩展解决方案,但其成功高度依赖有效的预训练。尽管已在多个手术下游任务中广泛研究,预训练在SSA中的应用仍鲜有探索。本文将SSA建模为少样本任务,系统研究自监督预训练策略对下游少样本评估性能的影响。我们为公开的机器人手术数据集标注了客观结构化技术技能(OSATS)评分,并在三种少样本设置下评估多种预训练来源。通过量化领域相似性,分析领域差异及手术特异性数据纳入预训练对迁移能力的影响。结果表明,小但领域相关的数据集可优于大规模、不匹配的数据集,在1-、2-和5-样本设置下分别实现60.16%、66.03%和73.65%的准确率。此外,将手术特异性数据与相关外部数据结合进行预训练,平均提升准确率1.22%、F1分数2.28%;而使用不相似的大规模源则可能导致性能下降。代码与模型已开源。
原文摘要 · Abstract (English)
Automated surgical skill assessment (SSA) is a central task in surgical computer vision. Developing robust SSA models is challenging due to the scarcity of skill annotations, which are time-consuming to produce and require expert consensus. Few-shot learning (FSL) offers a scalable alternative enabling model development with minimal supervision, though its success critically depends on effective pre-training. While widely studied for several surgical downstream tasks, pre-training has remained largely unexplored in SSA. In this work, we formulate SSA as a few-shot task and investigate how self-supervised pre-training strategies affect downstream few-shot SSA performance. We annotate a publicly available robotic surgery dataset with Objective Structured Assessment of Technical Skill (OSATS) scores, and evaluate various pre-training sources across three few-shot settings. We quantify domain similarity and analyze how domain gap and the inclusion of procedure-specific data into pre-training influence transferability. Our results show that small but domain-relevant datasets can outperform large scale, less aligned ones, achieving accuracies of 60.16%, 66.03%, and 73.65% in the 1-, 2-, and 5-shot settings, respectively. Moreover, incorporating procedure-specific data into pre-training with a domain-relevant external dataset significantly boosts downstream performance, with an average gain of +1.22% in accuracy and +2.28% in F1-score; however, applying the same strategy with less similar but large-scale sources can instead lead to performance degradation. Code and models are available at https://github.com/anastadimi/ssa-fsl.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。