用状态空间模型生成可控制的脑部纵向MRI,提升效率与质量。
CLIMB: Controllable Longitudinal Brain Image Generation using Mamba-based Latent Diffusion Model and Gaussian-aligned Autoencoder
- 基于状态空间模型替代自注意力,降低计算开销。
- 在ADNI数据集上生成图像结构相似度达0.9433,优于现有方法。
- 支持年龄、性别、疾病等多条件控制,适合临床研究与个性化预测。
潜在扩散模型在医学影像生成中表现出强大能力,可合成高质量脑部磁共振成像。尤其在预测患者脑结构演变方面,有助于早期干预、预后评估与治疗规划。本文提出CLIMB框架,基于状态空间的潜在扩散模型,用于建模脑结构随时间的动态变化。该模型以基线MRI扫描及其采集年龄为输入,并融合目标年龄、性别、疾病状态、遗传信息及脑区体积等多条件变量,实现对脑结构演化的精准控制。不同于依赖自注意力机制的现有潜在扩散模型(LDM),CLIMB采用状态空间模型架构,在显著降低计算开销的同时保持高质量图像生成能力。此外,引入高斯对齐自编码器,提取符合先验分布的潜在表征,避免传统变分自编码器中的采样噪声问题。模型在阿尔茨海默病神经影像倡议(ADNI)数据集上训练与评估,包含1,390名参与者共6,306张MRI扫描。通过与真实扫描对比,生成图像的结构相似性指数(SSIM)达到0.9433,显著优于现有方法。
原文摘要 · Abstract (English)
Latent diffusion models have emerged as powerful generative models in medical imaging, enabling the synthesis of high quality brain magnetic resonance imaging scans. In particular, predicting the evolution of a patients brain can aid in early intervention, prognosis, and treatment planning. In this study, we introduce CLIMB, Controllable Longitudinal brain Image generation via state space based latent diffusion model, an advanced framework for modeling temporal changes in brain structure. CLIMB is designed to model the structural evolution of the brain structure over time, utilizing a baseline MRI scan and its acquisition age as foundational inputs. Additionally, multiple conditional variables, including projected age, gender, disease status, genetic information, and brain structure volumes, are incorporated to enhance the temporal modeling of anatomical changes. Unlike existing LDM methods that rely on self attention modules, which effectively capture contextual information from input images but are computationally expensive, our approach leverages state space, a state space model architecture that substantially reduces computational overhead while preserving high-quality image synthesis. Furthermore, we introduce a Gaussian-aligned autoencoder that extracts latent representations conforming to prior distributions without the sampling noise inherent in conventional variational autoencoders. We train and evaluate our proposed model on the Alzheimers Disease Neuroimaging Initiative dataset, consisting of 6,306 MRI scans from 1,390 participants. By comparing generated images with real MRI scans, CLIMB achieves a structural similarity index of 0.9433, demonstrating notable improvements over existing methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。