arXiv:2505.05722cs.CV2025-05中稿 · CVPR

用自循环一致性过滤伪标签,仅靠80段无标注手术视频提升点追踪性能。

You Are Your Best Teacher: Semi-Supervised Surgical Point Tracking with Cycle-Consistent Self-Distillation

  • 固定教师模型生成伪标签,通过循环一致性剔除时间不一致轨迹。
  • 仅用80段无标注视频,在STIR数据集上显著提升追踪准确率。
  • 无需多教师架构,适合数据稀缺且域偏移严重的手术视频场景。

合成数据集通过提供大规模密集标注监督推动了点追踪的发展。然而,由于域偏移和标注数据缺乏,将这些模型部署到真实世界场景仍具挑战性,尤其在手术视频中,存在复杂的组织形变、遮挡和光照变化。尽管近期方法采用教师集成或增强密集的伪标签流程来适应自然视频,但在手术这类高域偏移场景中的有效性尚未被探索。本文提出SurgTracker,一种基于筛选式自蒸馏的半监督框架,用于将合成训练的点追踪器适配至手术视频。伪标签由固定教师(与学生同结构、同初始化)在线生成,并通过循环一致性约束过滤掉时间不一致的轨迹。该设计简单有效,强制几何一致性并提供稳定监督,无需维护多个教师带来的计算开销。在STIR基准上的实验表明,SurgTracker仅使用80段未标注视频即可显著提升追踪性能,展现了其在高域偏移、数据稀缺场景中的鲁棒适应潜力。

原文摘要 · Abstract (English)

Synthetic datasets have enabled significant progress in point tracking by providing large-scale, densely annotated supervision. However, deploying these models in real-world domains remains challenging due to domain shift and lack of labeled data-issues that are especially severe in surgical videos, where scenes exhibit complex tissue deformation, occlusion, and lighting variation. While recent approaches adapt synthetic-trained trackers to natural videos using teacher ensembles or augmentation-heavy pseudo-labeling pipelines, their effectiveness in high-shift domains like surgery remains unexplored. This work presents SurgTracker, a semi-supervised framework for adapting synthetic-trained point trackers to surgical video using filtered self-distillation. Pseudo-labels are generated online by a fixed teacher-identical in architecture and initialization to the student-and are filtered using a cycle consistency constraint to discard temporally inconsistent trajectories. This simple yet effective design enforces geometric consistency and provides stable supervision throughout training, without the computational overhead of maintaining multiple teachers. Experiments on the STIR benchmark show that SurgTracker improves tracking performance using only 80 unlabeled videos, demonstrating its potential for robust adaptation in high-shift, data-scarce domains.

点追踪半监督手术视频自蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。