MAISI-v2加速生成高质量3D医学图像,提升条件一致性与推理速度。
MAISI-v2: Accelerated 3D High-Resolution Medical Image Synthesis with Rectified Flow and Region-specific Contrastive Loss
- 采用修正流加速生成,替代传统扩散模型
- 实现33倍加速,保持顶尖图像质量
- 区域特异性对比损失增强关键区域对齐,适合医疗数据增强
医学图像合成在临床和研究中具有重要意义。近年来,扩散模型成为该领域的主流方法。然而,现有方法普遍存在三大问题:(1)泛化能力差,仅适用于特定解剖部位或体素间距;(2)推理速度慢,为扩散模型通病;(3)输入条件对齐弱,严重影响医学影像应用。此前提出的MAISI框架虽解决了泛化问题,但仍存在推理慢、条件一致性不足的缺陷。本文提出MAISI-v2,首个结合修正流的3D医学图像快速生成框架,实现高效高质合成。为进一步提升条件保真度,引入区域特异性对比损失,增强对感兴趣区域的敏感性。实验表明,MAISI-v2在潜在扩散模型上实现33倍加速,达到当前最优图像质量。下游分割实验验证了合成图像可用于数据增强。代码、训练细节、模型权重及图形界面演示已公开,以促进复现与社区发展。
原文摘要 · Abstract (English)
Medical image synthesis is an important topic for both clinical and research applications. Recently, diffusion models have become a leading approach in this area. Despite their strengths, many existing methods struggle with (1) limited generalizability that only work for specific body regions or voxel spacings, (2) slow inference, which is a common issue for diffusion models, and (3) weak alignment with input conditions, which is a critical issue for medical imaging. MAISI, a previously proposed framework, addresses generalizability issues but still suffers from slow inference and limited condition consistency. In this work, we present MAISI-v2, the first accelerated 3D medical image synthesis framework that integrates rectified flow to enable fast and high quality generation. To further enhance condition fidelity, we introduce a novel region-specific contrastive loss to enhance the sensitivity to region of interest. Our experiments show that MAISI-v2 can achieve SOTA image quality with $33 \times$ acceleration for latent diffusion model. We also conducted a downstream segmentation experiment to show that the synthetic images can be used for data augmentation. We release our code, training details, model weights, and a GUI demo to facilitate reproducibility and promote further development within the community.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。