arXiv:2606.19889cs.CV2026-06被引 1

SurgVista提升手术视频预测的长期准确性和物理一致性。

SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics

论文配图:SurgVista: Long-Horizon Surgical World Modeling with Plausible Instrument-Tissue Dynamics
图 1 · 摘自论文原文
  • 通过轨迹一致性正则化增强器械与组织交互的时空连贯性。
  • 长时程预测误差显著降低,视觉质量在长时间滚动中保持稳定。
  • 适合需要高精度手术模拟的机器人自主学习研究者使用。

机器人自主手术策略学习面临挑战:专家示范成本高,体内探索存在安全风险。手术世界模型可通过初始观测生成条件化的未来帧来缓解此问题,但现有方法存在两种顽固缺陷:空间交互不一致(可见器械接触未引发空间一致的组织形变)和时间保真度崩溃(自回归滚动中预测误差累积导致画面质量持续恶化)。我们提出SurgVista,一种手术世界模型,通过两项训练策略解决上述问题。变形一致性正则化从训练视频中提取场景点轨迹,通过潜在对比学习强制跨帧一致性,强化物理合理的器械-组织动态。漂移适应训练通过在线引入预测残差和基于长时程漂移统计校准的光照增强扰动条件帧,缓解长期漂移问题,维持长时间滚动下的视觉保真度。为进一步支持严谨评估,我们还构建了SurgWorld-Bench基准,包含多种术式、长序列滚动及解耦的器械运动精度与组织响应保真度指标。大量实验表明,SurgVista在视觉质量、时间一致性和交互保真度上均持续优于当前最优方法,且预测时长越长,优势越明显。

原文摘要 · Abstract (English)

Scaling robot policy learning for autonomous surgery is challenging, as expert demonstrations are expensive and in vivo exploration poses substantial safety risks. Surgical world models address this by generating realistic, action-conditioned future frames from an initial observation, but existing methods exhibit two persistent failure modes: spatial interaction incoherence, where visible instrument contact fails to induce spatially consistent tissue deformation, and temporal fidelity collapse, where prediction errors compound across autoregressive rollouts and progressively corrupt visual quality. We present SurgVista, a surgical world model that mitigates both failures through two training recipes. Deformation Consistency Regularization extracts scene-point trajectories from training videos and enforces cross-frame coherence through latent contrastive learning, strengthening physically consistent instrument-tissue dynamics. Drift Adaptation Training mitigates long-horizon drift by perturbing conditioning frames with online prediction residuals and photometric augmentations calibrated to long-horizon drift statistics, sustaining visual fidelity over extended rollouts. To enable rigorous evaluation, we further introduce SurgWorld-Bench, featuring diverse procedure types, long-range rollouts, and decoupled metrics for instrument-motion accuracy and tissue-response fidelity. Extensive experiments show that SurgVista consistently outperforms state-of-the-art methods across visual quality, temporal consistency, and interaction fidelity, with gains widening as the prediction horizon grows.

手术模拟世界模型长时预测物理一致性

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。