用对比回归提升手术技能评估的跨域泛化能力
CoRe-DA: Contrastive Regression for Unsupervised Domain Adaptation in Surgical Skill Assessment
- 通过相对评分监督和自训练学习跨域不变特征
- 在无标签目标数据下实现0.46和0.41的斯皮尔曼相关系数
- 适用于干实验与临床场景的手术技能自动评估
基于视觉的手术技能评估(SSA)可实现操作表现的客观、可扩展评价。该领域进展受限于量化技能评分的人工标注成本高、耗时长,以及现有回归模型在新手术任务和环境中的泛化能力差。当前大量未标注视频数据可用,推动了无监督域适应(UDA)方法在SSA中的发展。本文首次建立针对SSA回归的UDA基准,涵盖干实验与临床设置、开放与机器人手术的四个数据集。在复杂域偏移下评估八种代表性模型,并提出CoRe-DA——一种基于对比回归的新型适应框架。该方法通过相对评分监督和目标域自训练学习域不变表示。在两种UDA设置下的全面实验表明,CoRe-DA优于现有最先进方法,在干实验和临床目标数据集上分别达到0.46和0.41的斯皮尔曼相关系数,且训练中无需任何标注目标数据。整体上,CoRe-DA实现了可扩展、可靠跨域泛化的手术技能评估,而现有方法表现不佳。代码与数据集将公开于https://github.com/anastadimi/CoRe-DA。
原文摘要 · Abstract (English)
Vision-based surgical skill assessment (SSA) enables objective and scalable evaluation of operative performance. Progress in this field is constrained by the high cost and time demands for manual annotation of quantitative skill scores, as well as the poor generalization of existing regression models to new surgical tasks and environments. Meanwhile, appreciable volumes of unlabeled video data are now available, motivating the development of unsupervised domain adaptation (UDA) methods for SSA. We introduce the first benchmark for UDA in SSA regression, spanning four datasets across dry-lab and clinical settings as well as open and robotic surgery. We evaluate eight representative models under challenging domain shifts and propose CoRe-DA, a novel contrastive regression-based adaptation framework. Our method learns domain-invariant representations through relative-score supervision and target-domain self-training. Comprehensive experiments across two UDA settings show that CoRe-DA is superior to state-of-the-art methods, achieving Spearman Correlation Coefficients of 0.46 and 0.41 on dry-lab and clinical target datasets, respectively, without using any labeled target data for training. Overall, CoRe-DA enables scalable SSA with reliable cross-domain generalization, where existing methods underperform. Our code and datasets will be released at https://github.com/anastadimi/CoRe-DA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。