arXiv:2410.05027eess.IV2024-10被引 11

用扩散模型同时修复和生成多发性硬化病灶图像,提升分析准确性。

Bi-Directional MS Lesion Filling and Synthesis Using Denoising Diffusion Implicit Model-based Lesion Repainting

  • 基于去噪扩散隐式模型,实现病灶修复与合成双功能
  • 可生成无病灶的T1/FLAIR图像,或为健康人图像添加病灶
  • 适用于下游分析与病灶分割数据增强,效果良好

多发性硬化患者(PwMS)的磁共振图像自动处理广泛用于病灶分割与脑区划分,但病灶会干扰脑区划分等分析。病灶填充常被用来缓解此问题,但现有方法难以准确重建真实无病灶图像,影响后续分析一致性。此外,病灶分割算法受限于标注病灶的数据不足。本文提出一种基于去噪扩散隐式模型(DDIM)的新方法,实现多发性硬化病灶的填充与合成。经训练后,该模型可将含病灶的T1加权或FLAIR图像转换为无病灶图像;也可为健康人图像添加病灶。前者有助于需要无病灶图像的下游分析,后者可用于扩充病灶分割训练数据。初步实验验证了该方法在病灶填充与合成上的有效性,为未来研究奠定基础。

原文摘要 · Abstract (English)

Automatic magnetic resonance (MR) image processing pipelines are widely used to study people with multiple sclerosis (PwMS), encompassing tasks such as lesion segmentation and brain parcellation. However, the presence of lesion often complicates these analysis, particularly in brain parcellation. Lesion filling is commonly used to mitigate this issue, but existing lesion filling algorithms often fall short in accurately reconstructing realistic lesion-free images, which are vital for consistent downstream analysis. Additionally, the performance of lesion segmentation algorithms is often limited by insufficient data with lesion delineation as training labels. In this paper, we propose a novel approach leveraging Denoising Diffusion Implicit Models (DDIMs) for both MS lesion filling and synthesis based on image inpainting. Our modified DDIM architecture, once trained, enables both MS lesion filing and synthesis. Specifically, it can generate lesion-free T1-weighted or FLAIR images from those containing lesions; Or it can add lesions to T1-weighted or FLAIR images of healthy subjects. The former is essential for downstream analyses that require lesion-free images, while the latter is valuable for augmenting training datasets for lesion segmentation tasks. We validate our approach through initial experiments in this paper and demonstrate promising results in both lesion filling and synthesis, paving the way for future work.

病灶修复扩散模型医学图像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。