arXiv:2605.14889cs.CVcs.AI2026-05被引 1

提出双路径状态重排机制,提升手术阶段识别精度与效率

SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognition

论文配图:SurgicalMamba: Dual-Path SSD with State Regramming for Online Surgical Phase Recognition
图 1 · 摘自论文原文
  • 通过状态重排在分块边界旋转状态,区分重复视觉内容
  • 强度调制步进使相位转换处快速衰减,最长相位仍保持准确
  • 保持原有高效结构,单卡达312.88帧/秒,适合实时手术监控

在线手术阶段识别需在每帧做出判断,仅依赖历史帧信息,且每帧开销不随时间增长。结构化状态空间双重性(SSD)满足该约束,但仅能通过每头标量转移实现,固定了状态写入位置与衰减速率。同一视图在操作中反复出现,导致内容被覆盖,仅靠年龄区分。衰减速率由步骤决定,何时过去不再有用则需从无明确标记的损失函数中推断。手术持续时间长,帧间视觉变化小,导致选择依据不足。相位长度差异大,无法设定通用衰减速率。为此提出两种机制:状态重排在每个分块边界按内容决定旋转量,使相同视图因中间相位介入而分离,这是单一衰减速率无法实现的;强度调制步进在标注相位转换处增强衰减,使相位结束时状态迅速清空,中间缓慢衰减,衰减速率可针对最长期相设置。二者均保持SSD的N半可分结构和每帧O(d)计算成本。在七个公开基准上,SurgicalMamba达到领先性能:Cholec80上在线准确率94.6%,阶段级Jaccard为82.7%;AutoLaparo上分别为89.5%和68.9%,单卡运行速度达312.88 fps。仅加入旋转机制至Mamba2即显著提升多查询关联召回(MQAR),表明该机制不限于手术视频。

原文摘要 · Abstract (English)

Online surgical phase recognition must commit to a prediction at every frame of a procedure that runs for hours, from past frames alone and at a per-frame cost that does not grow with elapsed length. Structured state-space duality (SSD) meets that constraint, but only by having the scan see a per-head scalar transition, which fixes both where the state puts a frame and how fast it decays. The same views recur through an operation, so repeated content is written over itself and can afterwards be told apart only by age. How fast to decay is left to the step, and when the past stops being useful has to be inferred from a loss that never marks the moment. Procedures run long and change little visually from frame to frame, leaving the step with little to select on. Phases also vary widely in length, so no fixed rate serves as a fallback. We address the two with two mechanisms. State regramming rotates the carried state at each chunk boundary, by an amount the chunk's content decides, so where a frame is written also depends on what has passed since: two occurrences of the same view are held apart when different phases intervene, which no decay rate can achieve once both have aged. Intensity-modulated stepping increases the decay at the annotated phase transitions, so the state empties quickly where a phase ends and slowly in between and the decay itself can be set for the longest phase. Both leave SSD's N-semiseparable structure and O(d) per-frame cost intact. Across seven public benchmarks SurgicalMamba reaches state-of-the-art online accuracy and phase-level Jaccard (94.6%/82.7% on Cholec80, 89.5%/68.9% on AutoLaparo) at 312.88 fps on a single GPU. Adding the rotation alone to a plain Mamba2 improves multi-query associative recall (MQAR) wherever the recurrent state is the binding constraint, indicating that the mechanism is not specific to surgical video.

手术识别状态空间实时处理视频理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。