用普通脑扫描生成高价值髓鞘定量图,速度快精度高。
DEMIST: Decoupled Multi-stream latent diffusion for Quantitative Myelin Map Synthesis
- 分阶段训练:先学解码潜空间,再用三重条件控制扩散模型。
- 在99名患者163次扫描上测试,边界更清晰,定量值更准确。
- 适合多发性硬化研究者,可快速生成专业级髓鞘图像。
定量磁化转移(qMT)成像能提供髓鞘敏感生物标志物,如池大小比(PSR),对多发性硬化(MS)评估具有重要价值。然而,qMT需20-30分钟专用扫描。本文提出DEMIST,通过3D潜空间扩散模型,仅用标准T1w和FLAIR图像合成PSR图。方法分为两阶段:首先分别训练PSR与解剖图像的自编码器,学习对齐的潜表示;其次在冻结的扩散基础模型上,于潜空间训练条件扩散模型。条件机制解耦为:(i) 语义标记通过交叉注意力,(ii) 空间残差提示通过3D ControlNet分支,(iii) 自适应LoRA调制注意力。引入边缘感知损失以保持病灶边界,以及对齐损失以维持定量一致性,同时参数量低并保留预训练模型归纳偏置。在99名受试者的163次扫描上采用5折交叉验证。相比VAE、GAN及扩散基线,本方法在多个指标上表现更优,生成图像边界更锐利,定量一致性更高。代码已公开于https://github.com/MedICL-VU/MS-Synthesis-3DcLDM。
原文摘要 · Abstract (English)
Quantitative magnetization transfer (qMT) imaging provides myelin-sensitive biomarkers, such as the pool size ratio (PSR), which is valuable for multiple sclerosis (MS) assessment. However, qMT requires specialized 20-30 minute scans. We propose DEMIST to synthesize PSR maps from standard T1w and FLAIR images using a 3D latent diffusion model with three complementary conditioning mechanisms. Our approach has two stages: first, we train separate autoencoders for PSR and anatomical images to learn aligned latent representations. Second, we train a conditional diffusion model in this latent space on top of a frozen diffusion foundation backbone. Conditioning is decoupled into: (i) \textbf{semantic} tokens via cross-attention, (ii) \textbf{spatial} per-scale residual hints via a 3D ControlNet branch, and (iii) \textbf{adaptive} LoRA-modulated attention. We include edge-aware loss terms to preserve lesion boundaries and alignment losses to maintain quantitative consistency, while keeping the number of trainable parameters low and retaining the inductive bias of the pretrained model. We evaluate on 163 scans from 99 subjects using 5-fold cross-validation. Our method outperforms VAE, GAN and diffusion baselines on multiple metrics, producing sharper boundaries and better quantitative agreement with ground truth. Our code is publicly available at https://github.com/MedICL-VU/MS-Synthesis-3DcLDM.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。