arXiv:2507.14575cs.CVcs.AI2025-07被引 6

对比三类生成模型在脑部MRI图像转换中的表现,发现GAN效果最佳。

Benchmarking GANs, Diffusion Models, and Flow Matching for T1w-to-T2w MRI Translation

  • 使用相同设置比较GAN、扩散模型和流匹配方法
  • Pix2Pix GAN在结构保真度和图像质量上最优,且速度最快
  • 小数据集下流模型易过拟合,需更多数据才能超越GAN

磁共振成像(MRI)可获取多种图像对比度,如T1加权(T1w)和T2加权(T2w)扫描,各自提供不同的诊断信息。但获取所有模态会增加扫描时间和成本,推动了计算方法在跨模态合成中的研究。近期方法旨在从已采集的模态合成缺失的图像,以减少扫描时间并保持诊断质量。图像到图像(I2I)翻译为此任务提供了有效框架。本文对生成模型——包括生成对抗网络(GAN)、扩散模型和流匹配(FM)技术——在2D T1w-to-T2w MRI I2I转换中进行全面基准测试。所有方法在三个公开可用的健康成人脑部MRI数据集上实现并评估。定量与定性分析表明,基于GAN的Pix2Pix模型在结构保真度、图像质量和计算效率方面均优于扩散模型和基于FM的方法。与现有文献一致,结果表明流模型在小数据集和简单任务上容易过拟合,可能需要更多数据才能达到或超过GAN性能。这些发现为真实MRI工作流中部署I2I转换技术提供了实用指导,并指明了未来跨模态医学图像合成的研究方向。代码与模型已在https://github.com/AndreaMoschetto/medical-I2I-benchmark公开。

原文摘要 · Abstract (English)

Magnetic Resonance Imaging (MRI) enables the acquisition of multiple image contrasts, such as T1-weighted (T1w) and T2-weighted (T2w) scans, each offering distinct diagnostic insights. However, acquiring all desired modalities increases scan time and cost, motivating research into computational methods for cross-modal synthesis. To address this, recent approaches aim to synthesize missing MRI contrasts from those already acquired, reducing acquisition time while preserving diagnostic quality. Image-to-image (I2I) translation provides a promising framework for this task. In this paper, we present a comprehensive benchmark of generative models$\unicode{x2013}$specifically, Generative Adversarial Networks (GANs), diffusion models, and flow matching (FM) techniques$\unicode{x2013}$for T1w-to-T2w 2D MRI I2I translation. All frameworks are implemented with comparable settings and evaluated on three publicly available MRI datasets of healthy adults. Our quantitative and qualitative analyses show that the GAN-based Pix2Pix model outperforms diffusion and FM-based methods in terms of structural fidelity, image quality, and computational efficiency. Consistent with existing literature, these results suggest that flow-based models are prone to overfitting on small datasets and simpler tasks, and may require more data to match or surpass GAN performance. These findings offer practical guidance for deploying I2I translation techniques in real-world MRI workflows and highlight promising directions for future research in cross-modal medical image synthesis. Code and models are publicly available at https://github.com/AndreaMoschetto/medical-I2I-benchmark.

MRI生成图像翻译生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。