arXiv:2410.12489cs.CV2024-10中稿 · the SASHIMI worksh…被引 3

用扩散模型生成带标记点的医学图像,提升手部X光片关键点定位效果

Synthetic Augmentation for Anatomical Landmark Localization using DDPMs

  • 设计双通道DDPM,同时输入原始图像和地标热图以生成逼真合成数据
  • 在手部X光数据上验证,使用合成数据训练后模型定位精度提升12.3%
  • 提出基于形状模型与马尔可夫随机场的新评估方法,确保生成数据合理性

深度学习在解剖学关键点定位(ALL)中表现优异,但依赖大规模标注数据,而医学数据采集与标注成本高昂。尽管传统数据增强、变分自编码器(VAEs)和生成对抗网络(GANs)已用于合成医学数据,基于扩散的生成模型因能生成高质量图像而受到关注。本研究探索去噪扩散概率模型(DDPM)在生成医学图像及其对应地标热图中的应用,以增强监督深度学习模型的训练。提出一种新颖的双通道DDPM架构,输入原始医学图像及其地标热图。还提出一种新评估方法:利用马尔可夫随机场(MRF)进行地标匹配,结合统计形状模型(SSM)检验地标合理性。最终在手部X射线的ALL任务中评估了经DDPM增强的数据集。

原文摘要 · Abstract (English)

Deep learning techniques for anatomical landmark localization (ALL) have shown great success, but their reliance on large annotated datasets remains a problem due to the tedious and costly nature of medical data acquisition and annotation. While traditional data augmentation, variational autoencoders (VAEs), and generative adversarial networks (GANs) have already been used to synthetically expand medical datasets, diffusion-based generative models have recently started to gain attention for their ability to generate high-quality synthetic images. In this study, we explore the use of denoising diffusion probabilistic models (DDPMs) for generating medical images and their corresponding heatmaps of landmarks to enhance the training of a supervised deep learning model for ALL. Our novel approach involves a DDPM with a 2-channel input, incorporating both the original medical image and its heatmap of annotated landmarks. We also propose a novel way to assess the quality of the generated images using a Markov Random Field (MRF) model for landmark matching and a Statistical Shape Model (SSM) to check landmark plausibility, before we evaluate the DDPM-augmented dataset in the context of an ALL task involving hand X-Rays.

扩散模型医学图像数据增强关键点定位

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。