arXiv:2603.24897cs.CV2026-03

用自监督学习提升垂体瘤手术阶段识别准确率,支持实时分析与数据共享。

SurgPhase: Time efficient pituitary tumor surgery phase recognition via an interactive web platform

  • 基于自监督预训练+动态采样,解决标注数据少的问题。
  • 在81例手术上达到90%识别准确率,泛化性强。
  • 可交互平台让医生上传视频,持续优化模型,适合外科教学与质控。

精准的手术阶段识别对流程分析、术中决策支持以及推动外科教育和绩效评估的数字化至关重要。本文提出一个完整的垂体瘤手术(PTS)视频阶段识别框架,融合自监督表征学习、鲁棒的时间建模与可扩展的数据标注策略。方法在独立测试集上达到90%准确率,优于现有最先进方法,并在不同手术案例间表现出强泛化能力。核心贡献之一是构建了一个协作式在线平台,供外科医生上传手术视频,获取自动化阶段分析结果,并参与构建持续增长的数据集。该平台不仅促进大规模数据收集,还推动知识共享与模型迭代。为应对标注数据稀缺问题,我们在251段未标注的PTS视频上使用自监督框架预训练了ResNet-50模型,提取高质量特征表示;随后在81个已标注病例上,通过引入焦点损失、渐进式解冻层与动态采样策略的改进训练方案进行微调,有效缓解类别不平衡与手术变异性问题。

原文摘要 · Abstract (English)

Accurate surgical phase recognition is essential for analyzing procedural workflows, supporting intraoperative decision-making, and enabling data-driven improvements in surgical education and performance evaluation. In this work, we present a comprehensive framework for phase recognition in pituitary tumor surgery (PTS) videos, combining self-supervised representation learning, robust temporal modeling, and scalable data annotation strategies. Our method achieves 90\% accuracy on a held-out test set, outperforming current state-of-the-art approaches and demonstrating strong generalization across variable surgical cases. A central contribution of this work is the integration of a collaborative online platform designed for surgeons to upload surgical videos, receive automated phase analysis, and contribute to a growing dataset. This platform not only facilitates large-scale data collection but also fosters knowledge sharing and continuous model improvement. To address the challenge of limited labeled data, we pretrain a ResNet-50 model using the self-supervised framework on 251 unlabeled PTS videos, enabling the extraction of high-quality feature representations. Fine-tuning is performed on a labeled dataset of 81 procedures using a modified training regime that incorporates focal loss, gradual layer unfreezing, and dynamic sampling to address class imbalance and procedural variability.

手术识别自监督学习医疗数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。