arXiv:2501.03526eess.IVcs.CV2025-01被引 8

提出新模型统一补全多模态MRI,提升精度与速度。

FgC2F-UDiff: Frequency-guided and Coarse-to-fine Unified Diffusion Model for Multi-modality Missing MRI Synthesis

  • 分阶段去噪:从粗到细逐步还原图像细节
  • 利用频率信息引导非线性映射,增强重建质量
  • 专有加速机制支持多对多补全,临床实用性强

多模态磁共振成像(MRI)对脑肿瘤诊断和治疗至关重要,但受扫描时间、伪影、运动及对比剂不耐受等因素影响,常出现模态缺失。现有方法在泛化能力、非线性映射精度和处理速度方面仍存不足。为此,本文提出一种新型统一生成模型FgC2F-UDiff,支持多输入多输出。首先,采用粗到细统一网络(CUN),分两阶段利用扩散模型的迭代去噪特性,由全局到细节逐步提升合成图像保真度;其次,设计频率引导协同策略(FCS),引入适当频域信息作为先验知识,指导高非线性映射学习;第三,提出特定加速混合机制(SHM),集成专用加速组件,提升扩散模型效率,实现高效多对多合成。大量实验表明,该模型在两个数据集上均表现优异,通过定量指标(如PSNR、SSIM、LPIPS、FID)和定性观察综合验证,显著优于现有方法。

原文摘要 · Abstract (English)

Multi-modality magnetic resonance imaging (MRI) is essential for the diagnosis and treatment of brain tumors. However, missing modalities are commonly observed due to limitations in scan time, scan corruption, artifacts, motion, and contrast agent intolerance. Synthesis of missing MRI has been a means to address the limitations of modality insufficiency in clinical practice and research. However, there are still some challenges, such as poor generalization, inaccurate non-linear mapping, and slow processing speeds. To address the aforementioned issues, we propose a novel unified synthesis model, the Frequency-guided and Coarse-to-fine Unified Diffusion Model (FgC2F-UDiff), designed for multiple inputs and outputs. Specifically, the Coarse-to-fine Unified Network (CUN) fully exploits the iterative denoising properties of diffusion models, from global to detail, by dividing the denoising process into two stages, coarse and fine, to enhance the fidelity of synthesized images. Secondly, the Frequency-guided Collaborative Strategy (FCS) harnesses appropriate frequency information as prior knowledge to guide the learning of a unified, highly non-linear mapping. Thirdly, the Specific-acceleration Hybrid Mechanism (SHM) integrates specific mechanisms to accelerate the diffusion model and enhance the feasibility of many-to-many synthesis. Extensive experimental evaluations have demonstrated that our proposed FgC2F-UDiff model achieves superior performance on two datasets, validated through a comprehensive assessment that includes both qualitative observations and quantitative metrics, such as PSNR SSIM, LPIPS, and FID.

MRI补全扩散模型医学图像多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。