arXiv:2602.08822cs.CV2026-02

用统一模型实现鼻咽癌MRI任意模态间相互生成,提升放疗规划精度。

Any-to-All MRI Synthesis: A Unified Foundation Model for Nasopharyngeal Carcinoma and Its Downstream Applications

  • 基于对比学习与视觉语言对齐的统一模型,支持任意模态互转。
  • 在26个内外部数据集上平均SSIM达0.90,PSNR达27,抗噪鲁棒性强。
  • 适用于放疗分割等下游任务,临床实用性强,适合医学影像研究者。

磁共振成像(MRI)对鼻咽癌(NPC)放疗(RT)至关重要,但患者不适、扫描时间长和成本高常导致临床中模态不全,影响放疗计划准确性。传统MRI合成方法依赖特定模态,适应性差且缺乏临床可解释性,难以满足NPC放疗需求。本文提出一种统一的基础模型,融合对比视觉表征学习与视觉-语言对齐(VLA),实现任意模态间的全向MRI合成。模型采用对比编码器获取模态不变表征,结合基于CLIP的文本引导解码器,实现语义一致的合成。在13家机构共40,825张图像上训练,在26个内部/外部验证站点(共15,748张图像)上表现稳定,平均结构相似性(SSIM)达0.90,峰值信噪比(PSNR)为27,合成质量高且对噪声和域偏移具有强鲁棒性。同时,其统一表征显著提升下游放疗相关任务(如分割)性能。本工作通过基础模型推动鼻咽癌数字医疗解决方案,弥合技术合成与临床应用之间的鸿沟。

原文摘要 · Abstract (English)

Magnetic resonance imaging (MRI) is essential for nasopharyngeal carcinoma (NPC) radiotherapy (RT), but practical constraints, such as patient discomfort, long scan times, and high costs often lead to incomplete modalities in clinical practice, compromising RT planning accuracy. Traditional MRI synthesis methods are modality-specific, limited in anatomical adaptability, and lack clinical interpretability-failing to meet NPC's RT needs. Here, we developed a unified foundation model integrating contrastive visual representation learning and vision-language alignment (VLA) to enable any-to-all MRI synthesis. The model uses a contrastive encoder for modality-invariant representations and a CLIP-based text-informed decoder for semantically consistent synthesis, supporting any-to-all MRI synthesis via one unified foundation model. Trained on 40,825 images from 13 institutions, it achieves consistently high performance (average SSIM 0.90, PSNR 27) across 26 internal/external validation sites (15,748 images), with superior synthesis fidelity and robustness to noise and domain shifts. Meanwhile, its unified representation enhances downstream RT-relevant tasks (e.g., segmentation). This work advances digital medicine solutions for NPC care by leveraging foundation models to bridge technical synthesis and clinical utility.

MRI合成鼻咽癌基础模型放疗辅助

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。