用几何抽象生成手术室罕见事件视频,助力智能监测系统训练
Towards Controllable Video Synthesis of Routine and Rare OR Events
- 通过几何抽象与条件扩散模型,从抽象表征可控生成手术室视频
- 合成数据训练的模型检测近失事件召回率达70.13%
- 适用于医疗安全监控、智能手术辅助等场景
目的:构建涵盖罕见、高危或异常事件的大规模手术室(OR)工作流程数据集,在操作和伦理上仍具挑战性。这一数据瓶颈制约了环境智能在识别、理解与缓解手术室中罕见或高危事件方面的发展。方法:本文提出一种手术室视频扩散框架,实现对罕见及高危事件的可控合成。该框架整合几何抽象模块、条件模块与微调的扩散模型,先将手术室场景转换为抽象几何表示,再进行条件控制,最后生成逼真的事件视频。基于此框架,我们构建了一个合成数据集,用于训练和验证检测无菌区违规近似事件的AI模型。结果:在合成常规手术室事件时,本方法优于现成的视频扩散基线,在域内与域外数据集上均取得更低的FVD/LPIPS,更高的SSIM/PSNR。定性结果显示其可生成反事实事件。基于生成数据训练的AI模型在检测近高危事件时达到70.13%的召回率。最后,我们进行了消融实验,量化关键设计选择带来的性能提升。结论:本方案实现了从抽象几何表示中可控合成常规与罕见手术室事件。不仅展示了生成罕见与高危场景的能力,也证明了其支持环境智能模型发展的潜力。
原文摘要 · Abstract (English)
Purpose: Curating large-scale datasets of operating room (OR) workflow, encompassing rare, safety-critical, or atypical events, remains operationally and ethically challenging. This data bottleneck complicates the development of ambient intelligence for detecting, understanding, and mitigating rare or safety-critical events in the OR. Methods: This work presents an OR video diffusion framework that enables controlled synthesis of rare and safety-critical events. The framework integrates a geometric abstraction module, a conditioning module, and a fine-tuned diffusion model to first transform OR scenes into abstract geometric representations, then condition the synthesis process, and finally generate realistic OR event videos. Using this framework, we also curate a synthetic dataset to train and validate AI models for detecting near-misses of sterile-field violations. Results: In synthesizing routine OR events, our method outperforms off-the-shelf video diffusion baselines, achieving lower FVD/LPIPS and higher SSIM/PSNR in both in- and out-of-domain datasets. Through qualitative results, we illustrate its ability for controlled video synthesis of counterfactual events. An AI model trained and validated on the generated synthetic data achieved a RECALL of 70.13% in detecting near safety-critical events. Finally, we conduct an ablation study to quantify performance gains from key design choices. Conclusion: Our solution enables controlled synthesis of routine and rare OR events from abstract geometric representations. Beyond demonstrating its capability to generate rare and safety-critical scenarios, we show its potential to support the development of ambient intelligence models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。