用4维扩散变换器直接生成心脏动态影像,提升时序连贯性与生理合理性。
CardioDiT: Latent Diffusion Transformers for 4D Cardiac MRI Synthesis
- 设计4维扩散变换器,联合建模空间与时间,不拆分处理
- 在公开与私有数据集上实现更连贯的切片间一致性与真实心脏功能分布
- 适合心脏病影像生成、医学模拟等需要精准动态建模的研究者
潜在扩散模型(LDM)在3D医学图像合成中表现优异,但心电周期同步的短轴电影心脏磁共振(CMR)需建模额外的时间维度。现有方法多将时空分离或依赖解剖掩码保证时序一致性,引入结构偏差并导致细微时空断层或生理不一致。本文提出CardioDiT,一种基于扩散变换器的全4D潜在扩散框架,用于短轴电影CMR合成。通过时空向量量化变分自编码器(spatiotemporal VQ-VAE)将2D+t切片压缩为紧凑潜在表示,再由扩散变换器联合建模完整3D+t体积,全程耦合空间与时间。在公开数据集与更大规模私有队列上的评估表明,CardioDiT显著提升切片间一致性、时序连贯运动及真实心脏功能分布,证明显式4D建模结合扩散变换器可为时空心脏图像合成提供更合理的基础。代码与公共数据训练模型已开源于https://github.com/Cardio-AI/cardiodit。
原文摘要 · Abstract (English)
Latent diffusion models (LDMs) have recently achieved strong performance in 3D medical image synthesis. However, modalities like cine cardiac MRI (CMR), representing a temporally synchronized 3D volume across the cardiac cycle, add an additional dimension that most generative approaches do not model directly. Instead, they factorize space and time or enforce temporal consistency through auxiliary mechanisms such as anatomical masks. Such strategies introduce structural biases that may limit global context integration and lead to subtle spatiotemporal discontinuities or physiologically inconsistent cardiac dynamics. We investigate whether a unified 4D generative model can learn continuous cardiac dynamics without architectural factorization. We propose CardioDiT, a fully 4D latent diffusion framework for short-axis cine CMR synthesis based on diffusion transformers. A spatiotemporal VQ-VAE encodes 2D+t slices into compact latents, which a diffusion transformer then models jointly as complete 3D+t volumes, coupling space and time throughout the generative process. We evaluate CardioDiT on public CMR datasets and a larger private cohort, comparing it to baselines with progressively stronger spatiotemporal coupling. Results show improved inter-slice consistency, temporally coherent motion, and realistic cardiac function distributions, suggesting that explicit 4D modeling with a diffusion transformer provides a principled foundation for spatiotemporal cardiac image synthesis. Code and models trained on public data are available at https://github.com/Cardio-AI/cardiodit.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。