arXiv:2511.01775cs.CVcs.AI2025-11被引 10

用专家评估发现,视频生成模型在手术模拟中看似真实却缺乏深层因果理解。

How Far Are Surgeons from Surgical World Models? A Pilot Study on Zero-shot Surgical Video Generation with Expert Assessment

  • 构建首个外科视频生成评估基准SurgVeo与四层可解释性评估框架
  • Veo-3模型虽视觉逼真,但操作与策略层面严重失真
  • 为医疗AI提供从仿真到理解的演进路线图,适合临床与生成模型研究者

视频生成的基础模型在模拟物理世界方面展现出强大能力,但在需要深度专业因果知识的高风险领域如手术中仍存在显著空白。为此,我们提出SurgVeo——首个由专家标注的外科视频生成评估基准,以及外科合理性金字塔(Surgical Plausibility Pyramid, SPP)这一四层评估框架,涵盖从外观到复杂手术策略的多维度评估。基于SurgVeo,我们对先进模型Veo-3进行零样本任务测试,要求其生成腹腔镜与神经外科手术视频片段。四位持证外科医生依据SPP对生成视频进行评估。结果显示:尽管Veo-3在视觉感知合理性上表现优异,但在器械操作、环境反馈及手术意图等高层级评估中均出现明显缺陷。该工作首次提供了外科人工智能中‘视觉拟真’与‘因果理解’之间鸿沟的量化证据。SurgVeo与SPP的成果为未来能应对真实医疗场景复杂性的模型发展奠定了关键基础。

原文摘要 · Abstract (English)

Foundation models in video generation are demonstrating remarkable capabilities as potential world models for simulating the physical world. However, their application in high-stakes domains like surgery, which demand deep, specialized causal knowledge rather than general physical rules, remains a critical unexplored gap. To systematically address this challenge, we present SurgVeo, the first expert-curated benchmark for video generation model evaluation in surgery, and the Surgical Plausibility Pyramid (SPP), a novel, four-tiered framework tailored to assess model outputs from basic appearance to complex surgical strategy. On the basis of the SurgVeo benchmark, we task the advanced Veo-3 model with a zero-shot prediction task on surgical clips from laparoscopic and neurosurgical procedures. A panel of four board-certified surgeons evaluates the generated videos according to the SPP. Our results reveal a distinct "plausibility gap": while Veo-3 achieves exceptional Visual Perceptual Plausibility, it fails critically at higher levels of the SPP, including Instrument Operation Plausibility, Environment Feedback Plausibility, and Surgical Intent Plausibility. This work provides the first quantitative evidence of the chasm between visually convincing mimicry and causal understanding in surgical AI. Our findings from SurgVeo and the SPP establish a crucial foundation and roadmap for developing future models capable of navigating the complexities of specialized, real-world healthcare domains.

视频生成手术模拟评估框架因果理解

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。