提出双分支时序模型,精准区分手术出血与残留血迹。
DBT-Bleed: Dual-Branch Temporal Modeling with Key-Frame Selection for Surgical Bleeding Detection

- 设计双分支结构,分层建模短期与长期出血动态。
- 在MultiBypass数据集上提升F1 6.53%、MCC 9%。
- 适用于跨术式泛化,适合手术安全监测研究者。
术中不良事件(IAEs)检测对提升手术安全至关重要,出血是多种手术中最常见的事件之一。现有方法因缺乏充分的时序推理能力,难以区分出血与视觉相似的残留血液。同时,长视频建模在保持细粒度时序信息方面面临计算挑战。本文提出DBT-Bleed,一种双分支多尺度时序建模框架,通过逐层时序适配器解耦出血与正常状态表征。为高效处理长手术视频并保留关键时序信息,引入HiRED——一种分层熵驱动的帧选择策略,保留具有时序意义的片段,剔除冗余内容。在MultiBypass数据集上的实验显示,该方法在出血检测任务中实现F1提升6.53%、召回率提升5.62%、MCC提升9%,显著优于视频级基线。此外,在新构建的鼻内垂体手术数据集(EndoPit-IAE)上进行跨术式泛化评估,零样本设置下仍取得F1提升6%、MCC提升8%。该数据集为神经外科首个标注了术中不良事件的数据集。代码将在论文接受后公开。
原文摘要 · Abstract (English)
Intraoperative Adverse Events (IAEs) detection is critical for improving surgical safety, with bleeding being among the most frequent events across many surgery types. Existing methods struggle to distinguish bleeding IAE from visually similar residual blood due to limited temporal reasoning. Moreover, modeling long surgical videos while preserving fine-grained temporal dynamics remains computationally challenging. We propose DBT-Bleed, a dual-branch multi-scale temporal modeling framework disentangling bleeding and normal representations using layer-wise temporal adapters for short- and long-term bleeding progression. To efficiently process long surgical videos without sacrificing fine-grained temporal information, we introduce HiRED, a Hierarchical Entropy-Driven frame selection strategy that retains temporally informative segments while removing redundancy. Experiments on the MultiBypass dataset demonstrate gains of 6.53% in F1, 5.62% in Recall and 9% in MCC values for bleeding IAE detection, consistently outperforming video-level baselines. Additionally, we evaluate cross-procedure generalization on a newly curated dataset from a different surgical procedure type, where DBT-Bleed demonstrates robust transferability by achieving gain of 6% in F1 and 8% in MCC under zero-shot setting. To support this evaluation, we introduce EndoPit-IAE, an Endonasal Pituitary Surgery dataset annotated for IAEs, representing the first IAE-annotated dataset in neurosurgery. Code will be made publicly available upon acceptance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。