arXiv:2409.19371eess.IVcs.CV2024-09被引 2

用更高效扩散模型生成心脏超声图像,训练效果更好且省算力。

Efficient Semantic Diffusion Architectures for Model Training on Synthetic Echocardiograms

  • 基于Γ分布设计新型潜变量扩散模型,生成语义可控的超声图。
  • 生成图像虽不如其他模型逼真,但训练下游任务性能更优。
  • 适合需要大量合成数据但算力有限的研究者使用。

我们研究了扩散生成模型在高效合成数据以训练深度学习模型进行图像分析中的应用。具体提出一种新型Γ分布潜变量去噪扩散模型(LDM),用于生成具有语义引导的合成心脏超声图像,显著提升计算效率。同时考察这些合成图像是否可替代真实数据用于左心室分割和二分类超声视图识别任务的网络训练。对比了六种扩散模型在生成2D超声数据的计算成本、图像视觉真实性以及下游任务(分割与分类)在真实数据上的表现。还评估了不同扩散策略与常微分方程求解器对性能的影响。结果表明,所提架构显著降低计算开销,同时在下游任务中保持或优于现有方法的表现。尽管其他模型生成的图像更具视觉真实性但消耗更高算力,研究提示:对于模型训练而言,视觉真实性并非决定性能的关键因素,采用更高效模型可大幅节省计算资源。

原文摘要 · Abstract (English)

We investigate the utility of diffusion generative models to efficiently synthesise datasets that effectively train deep learning models for image analysis. Specifically, we propose novel $Γ$-distribution Latent Denoising Diffusion Models (LDMs) designed to generate semantically guided synthetic cardiac ultrasound images with improved computational efficiency. We also investigate the potential of using these synthetic images as a replacement for real data in training deep networks for left-ventricular segmentation and binary echocardiogram view classification tasks. We compared six diffusion models in terms of the computational cost of generating synthetic 2D echo data, the visual realism of the resulting images, and the performance, on real data, of downstream tasks (segmentation and classification) trained using these synthetic echoes. We compare various diffusion strategies and ODE solvers for their impact on segmentation and classification performance. The results show that our propose architectures significantly reduce computational costs while maintaining or improving downstream task performance compared to state-of-the-art methods. While other diffusion models generated more realistic-looking echo images at higher computational cost, our research suggests that for model training, visual realism is not necessarily related to model performance, and considerable compute costs can be saved by using more efficient models.

超声生成扩散模型医学图像高效训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。