首个面向手术器械运动规划的视觉基准,专测模型预测准确性与稳定性。
SurgWMBench: A Vision-Based Benchmark for World-Modeling Surgical Instrument Motion Planning

- 基于术中图像和历史轨迹,预测短时器械运动路径。
- 评估预测轨迹在连续推演中的几何准确性和时间一致性。
- 填补手术世界模型缺乏运动导向评测标准的空白,适合临床决策研究者。
可靠的外科规划需超越当前手术阶段识别或模仿专家操作,转而预判器械运动如何改变后续手术状态。现有外科视频理解方法多聚焦于阶段、动作或流程识别,对器械运动建模支持有限;而现有器械运动预测方法虽能预报轨迹,却未能捕捉未来手术视频状态的耦合演化。世界模型为联合建模视觉状态转移与器械运动动态提供了自然框架。然而,现有外科世界模型研究仍主要集中于视觉生成质量,依赖如FVD和CD-FVD等生成导向指标,这些指标与器械运动规划关联性弱,无法直接衡量预测轨迹的几何精度、时间连贯性或下游规划可用性。这一局限部分源于领域缺乏公开数据集与标准化评估协议,难以支撑运动中心能力的基准测试。本文提出SurgWMBench,一个面向短时程手术运动规划与动力学预测的视觉基准。给定术中图像序列及历史器械轨迹,该基准评估近未来器械运动预测性能,以及在连续推演或输入扰动下的稳定性。
原文摘要 · Abstract (English)
Reliable surgical planning requires models that move beyond recognizing the current surgical step or imitating expert demonstrations, and instead anticipate how instrument motion reshapes subsequent operative states. Most surgical video understanding methods focus on recognizing phases, actions, or workflow states, while providing limited support for explicitly modeling instrument motion. Conversely, existing tool motion prediction methods can forecast instrument trajectories, but they generally do not capture the coupled evolution of future surgical video states. World models offer a natural framework for jointly modeling visual state transitions and instrument motion dynamics. However, existing surgical world model studies remain largely centered on visual generation quality, relying on generation-oriented metrics such as FVD and CD-FVD. These metrics are poorly aligned with instrument motion planning, as they do not directly measure whether predicted trajectories are geometrically accurate, temporally coherent, or actionable for downstream planning. This limitation is partly structural, since the field lacks public datasets and standardized evaluation protocols that provide the benchmarking infrastructure needed to assess motion-centric capabilities in surgical world models. In this paper, we introduce SurgWMBench, a vision-based benchmark for short-horizon surgical motion planning and dynamics prediction. Given intraoperative image sequences and historical instrument trajectory, SurgWMBench evaluates both near-future instrument motion prediction and stability under continuous rollout or input perturbations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。