用解剖模型生成真实感超声图像,提升心脏病诊断模型性能。
Transesophageal Echocardiography Generation using Anatomical Models
- 基于解剖模型转换生成合成经食道超声图像。
- 数据增强后心室分割任务的Dice分数提升最高10%。
- 适合医学影像算法研究者与心脏病学工程团队。
通过自动化和深度学习(DL),可提升经食道超声(TEE)图像的分析效率。然而,深度学习方法需要大量高质量数据才能获得准确结果,这难以满足。数据增强常被用于解决此问题。本文提出一个生成合成TEE图像及对应语义标签的流程。该流程在已有生成胸壁超声图像的管道基础上,将解剖模型切片转换为合成图像。我们进一步证明,此类图像能通过左心室语义分割任务提升深度网络性能。在无配对图像到图像(I2I)翻译环节,探索了CycleGAN与对比无配对翻译两种生成方法。定量评估使用Fréchet Inception Distance(FID)分数,定性评估则通过专家心脏病学家与普通研究人员的人类感知测试。研究发现,使用合成图像进行数据增强后,Dice分数最高提升10%。此外,不同评估方法在合成图像效果上存在分歧,最终确定哪个指标更优预测其作为数据增强的有效性。
原文摘要 · Abstract (English)
Through automation, deep learning (DL) can enhance the analysis of transesophageal echocardiography (TEE) images. However, DL methods require large amounts of high-quality data to produce accurate results, which is difficult to satisfy. Data augmentation is commonly used to tackle this issue. In this work, we develop a pipeline to generate synthetic TEE images and corresponding semantic labels. The proposed data generation pipeline expands on an existing pipeline that generates synthetic transthoracic echocardiography images by transforming slices from anatomical models into synthetic images. We also demonstrate that such images can improve DL network performance through a left-ventricle semantic segmentation task. For the pipeline's unpaired image-to-image (I2I) translation section, we explore two generative methods: CycleGAN and contrastive unpaired translation. Next, we evaluate the synthetic images quantitatively using the Fréchet Inception Distance (FID) Score and qualitatively through a human perception quiz involving expert cardiologists and the average researcher. In this study, we achieve a dice score improvement of up to 10% when we augment datasets with our synthetic images. Furthermore, we compare established methods of assessing unpaired I2I translation and observe a disagreement when evaluating the synthetic images. Finally, we see which metric better predicts the generated data's efficacy when used for data augmentation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。