arXiv:2602.19723cs.CV2026-02被引 1

跨数据集的个性化MRI模态合成,提升真实场景诊断可靠性

Towards Personalized Multi-Modal MRI Synthesis across Heterogeneous Datasets

  • 根据数据集特征动态调整特征表示,缓解分布差异
  • 在四个临床数据集上均优于现有方法,PSNR与SSIM更优
  • 适合需要处理多源异构MRI数据的医疗影像研究者

多模态磁共振成像(MRI)中缺失模态的合成对保障诊断完整性至关重要,尤其在时间受限、运动伪影或患者耐受性不足时。现有统一合成模型通常仅在单一数据集训练和评估,泛化能力有限。为此,我们提出PMM-Synth,一种支持多种合成任务且能跨异构数据集有效泛化的个性化MRI合成框架。该框架在多个具有不同模态覆盖、疾病类型和强度分布的多模态MRI数据集上联合训练,通过三项核心创新实现跨数据集泛化:个性化特征调制模块,基于数据集标识动态适配特征表示以缓解分布偏移;模态一致批调度器,确保在模态不一致条件下稳定高效训练;选择性监督损失,当真实模态部分缺失时仍保证有效学习。在四个临床多模态MRI数据集上的评估显示,PMM-Synth在一对一和多对一合成任务中持续优于当前最优方法,达到更高PSNR和SSIM。定性结果表明其能更好保留解剖结构与病灶细节。下游肿瘤分割与放射科报告研究进一步验证其在真实模态缺失场景下支持可靠诊断的潜力。

原文摘要 · Abstract (English)

Synthesizing missing modalities in multi-modal magnetic resonance imaging (MRI) is vital for ensuring diagnostic completeness, particularly when full acquisitions are infeasible due to time constraints, motion artifacts, and patient tolerance. Recent unified synthesis models have enabled flexible synthesis tasks by accommodating various input-output configurations. However, their training and evaluation are typically restricted to a single dataset, limiting their generalizability across diverse clinical datasets and impeding practical deployment. To address this limitation, we propose PMM-Synth, a personalized MRI synthesis framework that not only supports various synthesis tasks but also generalizes effectively across heterogeneous datasets. PMM-Synth is jointly trained on multiple multi-modal MRI datasets that differ in modality coverage, disease types, and intensity distributions. It achieves cross-dataset generalization through three core innovations: a Personalized Feature Modulation module that dynamically adapts feature representations based on dataset identifier to mitigate the impact of distributional shifts; a Modality-Consistent Batch Scheduler that facilitates stable and efficient batch training under inconsistent modality conditions; and a selective supervision loss to ensure effective learning when ground truth modalities are partially missing. Evaluated on four clinical multi-modal MRI datasets, PMM-Synth consistently outperforms state-of-the-art methods in both one-to-one and many-to-one synthesis tasks, achieving superior PSNR and SSIM scores. Qualitative results further demonstrate improved preservation of anatomical structures and pathological details. Additionally, downstream tumor segmentation and radiological reporting studies suggest that PMM-Synth holds potential for supporting reliable diagnosis under real-world modality-missing scenarios.

MRI合成多模态跨数据集医疗影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。