用MRI生成淀粉样蛋白PET图像,提升阿尔茨海默病筛查效率
CoCoLIT: ControlNet-Conditioned Latent Image Translation for MRI to Amyloid PET Synthesis
- 基于扩散模型的潜在空间生成框架,结合ControlNet实现精准模态转换
- 在外部数据集上淀粉样蛋白分类准确率提升23.7%,显著优于现有方法
- 适合医学影像合成、阿尔茨海默病早期筛查领域的研究者与临床应用
从更常见且易获取的结构磁共振成像(MRI)合成淀粉样蛋白正电子发射断层扫描(amyloid PET)图像,为大规模阿尔茨海默病(AD)筛查提供一种有前景且成本更低的方法。尽管MRI不直接检测淀粉样病理,但其可能编码与淀粉样沉积相关的信息,可通过先进建模揭示。然而,三维神经影像数据的高维性和结构复杂性给现有MRI到PET的转换方法带来挑战。在低维潜在空间中建模跨模态关系可简化学习任务并提升转换效果。为此,我们提出CoCoLIT(ControlNet-Conditioned Latent Image Translation),一种基于扩散的潜在生成框架,包含三项创新:(1)新颖的加权图像空间损失(WISL),提升潜在表示学习和合成质量;(2)对潜在平均稳定化(LAS)技术的理论与实证分析,该技术用于增强生成一致性;(3)引入ControlNet作为条件机制进行MRI到PET转换。我们在公开数据集上评估了CoCoLIT性能,结果表明该模型在图像级和淀粉样相关指标上均显著优于现有最先进方法。特别地,在淀粉样蛋白阳性分类任务中,内部数据集上较次优方法提升10.5%,外部数据集上提升23.7%。代码与模型已开源:https://github.com/brAIn-science/CoCoLIT。
原文摘要 · Abstract (English)
Synthesizing amyloid PET scans from the more widely available and accessible structural MRI modality offers a promising, cost-effective approach for large-scale Alzheimer's Disease (AD) screening. This is motivated by evidence that, while MRI does not directly detect amyloid pathology, it may nonetheless encode information correlated with amyloid deposition that can be uncovered through advanced modeling. However, the high dimensionality and structural complexity of 3D neuroimaging data pose significant challenges for existing MRI-to-PET translation methods. Modeling the cross-modality relationship in a lower-dimensional latent space can simplify the learning task and enable more effective translation. As such, we present CoCoLIT (ControlNet-Conditioned Latent Image Translation), a diffusion-based latent generative framework that incorporates three main innovations: (1) a novel Weighted Image Space Loss (WISL) that improves latent representation learning and synthesis quality; (2) a theoretical and empirical analysis of Latent Average Stabilization (LAS), an existing technique used in similar generative models to enhance inference consistency; and (3) the introduction of ControlNet-based conditioning for MRI-to-PET translation. We evaluate CoCoLIT's performance on publicly available datasets and find that our model significantly outperforms state-of-the-art methods on both image-based and amyloid-related metrics. Notably, in amyloid-positivity classification, CoCoLIT outperforms the second-best method with improvements of +10.5% on the internal dataset and +23.7% on the external dataset. The code and models of our approach are available at https://github.com/brAIn-science/CoCoLIT.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。