arXiv:2512.07674cs.CVcs.AI2025-12被引 2

用解耦表征实现任意元数据或图像引导的MRI统一化,提升临床适用性。

DIST-CLIP: Arbitrary Metadata and Image Guided MRI Harmonization via Disentangled Anatomy-Contrast Representations

  • 解耦解剖与对比度表征,用CLIP提取对比度嵌入
  • 在真实临床数据上优于现有方法,兼顾风格迁移与解剖保真
  • 支持图像或元数据引导,适合复杂多源医疗影像场景

深度学习在医学影像分析中潜力巨大,但其临床泛化能力受限于数据异质性。磁共振成像中,扫描仪硬件差异、采集协议多样及序列参数变化导致显著域偏移,掩盖了潜在生物信号。现有数据统一化方法仍不足:基于图像的方法需目标图像,文本引导方法依赖简单标签,难以捕捉复杂采集细节,且常局限于低变异数据集。为此,我们提出DIST-CLIP(解耦风格迁移结合CLIP引导),一种统一框架,可灵活使用目标图像或DICOM元数据进行引导。该框架显式解耦解剖内容与图像对比度,通过预训练的CLIP编码器提取对比度表征,并利用新型自适应风格迁移模块将其融入解剖内容。我们在多样化真实临床数据集上训练并评估了DIST-CLIP,结果表明其在风格迁移保真度和解剖结构保留方面均显著优于现有最先进方法,为影像风格转换与标准化提供了灵活解决方案。代码与权重将在发表后公开。

原文摘要 · Abstract (English)

Deep learning holds immense promise for transforming medical image analysis, yet its clinical generalization remains profoundly limited. A major barrier is data heterogeneity. This is particularly true in Magnetic Resonance Imaging, where scanner hardware differences, diverse acquisition protocols, and varying sequence parameters introduce substantial domain shifts that obscure underlying biological signals. Data harmonization methods aim to reduce these instrumental and acquisition variability, but existing approaches remain insufficient. When applied to imaging data, image-based harmonization approaches are often restricted by the need for target images, while existing text-guided methods rely on simplistic labels that fail to capture complex acquisition details or are typically restricted to datasets with limited variability, failing to capture the heterogeneity of real-world clinical environments. To address these limitations, we propose DIST-CLIP (Disentangled Style Transfer with CLIP Guidance), a unified framework for MRI harmonization that flexibly uses either target images or DICOM metadata for guidance. Our framework explicitly disentangles anatomical content from image contrast, with the contrast representations being extracted using pre-trained CLIP encoders. These contrast embeddings are then integrated into the anatomical content via a novel Adaptive Style Transfer module. We trained and evaluated DIST-CLIP on diverse real-world clinical datasets, and showed significant improvements in performance when compared against state-of-the-art methods in both style translation fidelity and anatomical preservation, offering a flexible solution for style transfer and standardizing MRI data. Our code and weights will be made publicly available upon publication.

MRI统一化解耦表征CLIP医学影像

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。