用随机与确定模型协同训练,提升手术流程预测准确性
CoStoDet-DDPM: Collaborative Training of Stochastic and Deterministic Models Improves Surgical Workflow Anticipation and Recognition
- 引入扩散模型捕捉手术不确定性,与传统模型协同优化特征
- 在Cholec80上预测误差降16%,相位识别Jaccard提升1.0%
- 推理时丢弃随机分支,兼顾实时性与泛化能力,适合临床部署
手术流程的预测与识别对智能手术辅助系统至关重要。现有方法依赖确定性决策,难以应对真实手术中复杂的解剖与操作差异。本文提出一种新框架,将去噪扩散概率模型(DDPM)融入传统确定性学习,实现随机与确定模型的协同共训练:DDPM分支捕捉操作不确定性以增强特征表示,任务分支专注预测手术阶段与器械使用。理论上,二者相互优化——DDPM降低不确定场景下的预测误差,任务分支引导DDPM生成临床有意义表征。值得注意的是,推理时可舍弃DDPM分支,实现无损精度的实时预测。在Cholec80数据集上,本方法使预测误差eMAE降低16%,相位识别Jaccard得分提升1.0%;在AutoLaparo数据集上,相位识别Jaccard得分提升1.5%,且对患者特异性变化具有强鲁棒性。代码与权重已公开于https://github.com/kk42yy/CoStoDet-DDPM。
原文摘要 · Abstract (English)
Anticipating and recognizing surgical workflows are critical for intelligent surgical assistance systems. However, existing methods rely on deterministic decision-making, struggling to generalize across the large anatomical and procedural variations inherent in real-world surgeries.In this paper, we introduce an innovative framework that incorporates stochastic modeling through a denoising diffusion probabilistic model (DDPM) into conventional deterministic learning for surgical workflow analysis. At the heart of our approach is a collaborative co-training paradigm: the DDPM branch captures procedural uncertainties to enrich feature representations, while the task branch focuses on predicting surgical phases and instrument usage.Theoretically, we demonstrate that this mutual refinement mechanism benefits both branches: the DDPM reduces prediction errors in uncertain scenarios, and the task branch directs the DDPM toward clinically meaningful representations. Notably, the DDPM branch is discarded during inference, enabling real-time predictions without sacrificing accuracy.Experiments on the Cholec80 dataset show that for the anticipation task, our method achieves a 16% reduction in eMAE compared to state-of-the-art approaches, and for phase recognition, it improves the Jaccard score by 1.0%. Additionally, on the AutoLaparo dataset, our method achieves a 1.5% improvement in the Jaccard score for phase recognition, while also exhibiting robust generalization to patient-specific variations. Our code and weight are available at https://github.com/kk42yy/CoStoDet-DDPM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。