用2D扩散模型生成合成X光片,可替代真实数据训练手术导航AI。
2D Versus 3D Diffusion for In Silico Training of Interventional X-ray AI Models

- 用2D扩散模型直接生成合成X光图像,无需真实3D解剖模型
- 合成数据训练的定位模型在真实图像上表现接近真实数据训练
- 适合需要大量多样化训练数据的医疗影像AI研发者
真实X光图像的缺乏限制了介入式X光影像AI模型的发展。以往方法依赖高分辨率解剖模型生成数字重建放射图像(DRRs),但这些模型通常来自真实患者或标本的CT扫描,数据量和多样性受限。本文探索两种新方法:(1) 使用3D条件潜空间扩散模型生成用于机制化DRR生成的CT体积;(2) 使用视图条件2D扩散模型直接生成合成X光图像。在受控实验中,我们证明仅用合成2D扩散生成的X光图像训练的解剖标志检测模型,在真实X光图像上表现与真实数据训练模型相当。结果表明,基于2D扩散的合成数据可作为真实数据的有效替代,为构建大规模、多样化数据集提供了可行路径。
原文摘要 · Abstract (English)
The ability to synthesize realistic X-ray images has catalyzed the development of AI models for X-ray image-guided procedures, which otherwise suffer from a lack of available annotated data. Prior work has demonstrated the effectiveness of mechanistic simulation of digitally reconstructed radiographs (DRRs) as a training data source for a myriad of tasks, including segmentation and anatomical landmark detection, with comparable or superior performance to real data training. However, mechanistic DRR synthesis still relies on the availability of annotated high-resolution anatomical models. Deriving these from CT images of real patients or specimens imposes an undesirable bottleneck on data quantity and variability. In this work, we explore two methods for synthesizing training data: (1) a 3D conditional latent diffusion model that generates CT volumes to use as inputs for mechanistic DRR generation without real, 3D anatomical models, and (2) a view-conditioned 2D diffusion model that produces synthetic X-rays. In controlled experiments, we demonstrate that synthetic 2D diffusion-based X-rays can be used to train an anatomical landmark detection model that generalized to real X-ray images with performance rivaling that of a model trained on real X-ray images. Thus, we provide preliminary evidence that synthetic, 2D diffusion-based training data can substitute for real X-ray data, identifying a promising avenue towards generating large, diverse datasets for training robust AI models in interventional X-ray imaging.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。