用PET引导的扩散模型,让全身MRI生成更准更真实。
Heterogeneity-Adaptive Diffusion Schrodinger Bridge for PET-Guided Whole-Body MRI Translation

- 通过视觉语言模型提取区域上下文,自适应建模不同身体部位差异。
- 结合PET代谢信息,在病变区域显著提升生成质量。
- 适合需要高精度全身MRI重建的临床影像研究者。
全身体部多模态医学成像设备虽具临床价值,但PET-MR扫描时间过长限制了其效率。基于深度学习的MRI翻译可缩短扫描时间,但现有方法多聚焦特定解剖区域,难以应对全身扫描中因解剖差异与病灶组织导致的特征分布高度异质性问题。本文提出一种异质性自适应扩散薛定谔桥(HA-DSB)框架,将翻译建模为源与目标分布间的随机传输过程。通过视觉语言模型(VLM)生成的区域上下文嵌入实现区域特异性建模,并引入病变感知的代谢先验:在前向过程中,由PET引导的噪声调制模块自适应调节空间扩散扰动;在反向过程中,利用注意力机制增强病变相关结构的生成。实验表明,该方法在全身各区域均表现优异,且在病灶区域显著提升生成质量。代码已开源。
原文摘要 · Abstract (English)
While whole-body multimodal medical imaging scanners have been increasingly recognized for more effective medical applications, the excessive long acquisition time in PET-MR scanning is a major obstacle in more efficient clinical practice. Deep learning-based MRI translation provides a potential solution to reduce scan duration. However, current models often focus on specific anatomical regions and face challenges for whole-body scans that consists of highly heterogeneous feature distributions mainly due to (1) different anatomical regions across whole-body, and (2) lesions or pathological tissues. This paper tackles the challenges through a novel Heterogeneity-Adaptive Diffusion Schrodinger Bridge (HA-DSB) framework. By explicitly modeling translation as stochastic transport between source and target distributions, HA-DSB incorporates region context embeddings derived from a vision-language model (VLM) to enable region-specific modeling. To enhance fidelity of the pathological tissue, lesion-aware metabolic prior from PET is integrated directly into the bridge dynamics through a dual-stage guidance mechanism. Specifically, a PET-guided noise modulation module adaptively scales spatial diffusion perturbations during the forward process, while PET features are leveraged during the reverse process to selectively amplify lesion-relevant structures via an attention mechanism. Experiments demonstrate the superiority of our method across different body regions in whole-body MRI translation and show improved translation quality in lesion areas under PET guidance. Our code is available at Github.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。