arXiv:2507.00043cs.CVcs.AI2025-07被引 6

用DICOM元数据训练MRI图像对比度表示,无需人工标签

MR-CLIP: Efficient Metadata-Guided Learning of MRI Contrast Representations

  • 通过图像与元数据对比学习,自动捕捉扫描参数对应的对比度特征
  • 在跨模态检索和对比度分类任务中表现优异,支持多设备多协议数据
  • 适合临床影像分析、数据标准化及跨模态研究的开发者使用

临床MRI图像的准确解读依赖于对图像对比度的精确理解。对比度主要由采集参数(如回波时间、重复时间)决定,这些信息存储在DICOM元数据中。常用标签如T1加权或T2加权仅提供粗略近似,且在许多真实数据集中缺失。此外,元数据常不完整、嘈杂或不一致,阻碍了图像解读、检索及临床流程集成。为应对这些挑战,我们提出MR-CLIP,一种多模态对比学习框架,将MRI图像与其DICOM元数据对齐,学习无监督的对比度感知表示。该模型在覆盖多种扫描仪和协议的临床数据集上训练,能捕捉不同采集间的对比度变化以及同一扫描内的差异,实现解剖无关的表示。实验显示其在跨模态检索和对比度分类任务中效果显著,具备可扩展性,适用于模态不变表示与数据调和等高级临床应用。代码与权重已公开于https://github.com/myigitavci/MR-CLIP。

原文摘要 · Abstract (English)

Accurate interpretation of Magnetic Resonance Imaging scans in clinical systems is based on a precise understanding of image contrast. This contrast is primarily governed by acquisition parameters, such as echo time and repetition time, which are stored in the DICOM metadata. To simplify contrast identification, broad labels such as T1-weighted or T2-weighted are commonly used, but these offer only a coarse approximation of the underlying acquisition settings. In many real-world datasets, such labels are entirely missing, leaving raw acquisition parameters as the only indicators of contrast. Adding to this challenge, the available metadata is often incomplete, noisy, or inconsistent. The lack of reliable and standardized metadata complicates tasks such as image interpretation, retrieval, and integration into clinical workflows. Furthermore, robust contrast-aware representations are essential to enable more advanced clinical applications, such as achieving modality-invariant representations and data harmonization. To address these challenges, we propose MR-CLIP, a multimodal contrastive learning framework that aligns MR images with their DICOM metadata to learn contrast-aware representations, without relying on manual labels. Trained on a diverse clinical dataset that spans various scanners and protocols, MR-CLIP captures contrast variations across acquisitions and within scans, enabling anatomy-invariant representations. We demonstrate its effectiveness in cross-modal retrieval and contrast classification, highlighting its scalability and potential for further clinical applications. The code and weights are publicly available at https://github.com/myigitavci/MR-CLIP.

MRI对比度学习元数据多模态

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。