用状态机机制提升手术阶段识别的连续性与准确性
Neural Finite-State Machines for Surgical Phase Recognition
- 将经典状态转移先验融入神经网络,实现阶段间时序连贯建模
- 在BernBypass70数据集上视频级准确率提升0.9点,多指标平均增益超3点
- 可插拔集成,适合各类手术识别模型,尤其适合长序列分析场景
手术阶段识别(SPR)对流程优化、能力评估和实时干预具有重要意义。然而现有深度学习模型常产生碎片化预测,难以捕捉手术流程的时序特性。本文提出神经有限状态机(NFSM),通过融合经典状态转移先验与现代神经网络,强制实现时间一致性。NFSM利用可学习的全局状态嵌入作为唯一阶段标识,并通过动态转移表建模阶段演化。此外,采用重复帧填充的未来阶段预测机制,提前感知潜在转换。作为即插即用模块,NFSM可无缝集成至现有SPR系统而无需修改核心架构。在多个基准测试中表现优异,尤其在BernBypass70数据集上,视频级准确率提升0.9点,阶段级精确率、召回率、F1分数和mAP分别提高3.8、3.1、3.3和4.1。消融实验验证各组件有效性及对不同架构的适应性。该方法将有限状态原理与深度学习结合,为长期手术视频分析提供了稳健路径。
原文摘要 · Abstract (English)
Surgical phase recognition (SPR) is crucial for applications in workflow optimization, performance evaluation, and real-time intervention guidance. However, current deep learning models often struggle with fragmented predictions, failing to capture the sequential nature of surgical workflows. We propose the Neural Finite-State Machine (NFSM), a novel approach that enforces temporal coherence by integrating classical state-transition priors with modern neural networks. NFSM leverages learnable global state embeddings as unique phase identifiers and dynamic transition tables to model phase-to-phase progressions. Additionally, a future phase forecasting mechanism employs repeated frame padding to anticipate upcoming transitions. Implemented as a plug-and-play module, NFSM can be integrated into existing SPR pipelines without changing their core architectures. We demonstrate state-of-the-art performance across multiple benchmarks, including a significant improvement on the BernBypass70 dataset - raising video-level accuracy by 0.9 points and phase-level precision, recall, F1-score, and mAP by 3.8, 3.1, 3.3, and 4.1, respectively. Ablation studies confirm each component's effectiveness and the module's adaptability to various architectures. By unifying finite-state principles with deep learning, NFSM offers a robust path toward consistent, long-term surgical video analysis.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。