arXiv:2608.24342cs.CVcs.AI2026-08

用患者元数据生成更真实的心脏核磁图像,解决临床数据不足问题。

Metadata-Aware Adaptation of a Generative Foundation Model for Conditional CMR Synthesis

论文配图:Metadata-Aware Adaptation of a Generative Foundation Model for Conditional CMR Synthesis
图 1 · 摘自论文原文
  • 用结构化临床数据作提示词,引导扩散模型生成心脏核磁图像。
  • FID达37.47,比基线提升57%,且仅依赖元数据而非解剖结构。
  • 适合医学影像生成、数据增强及临床研究者使用。

合成图像生成是缓解医学影像数据稀缺与重要临床表型缺失的有效策略,但如何生成真实反映患者特征的图像仍具挑战。本文研究基于预训练潜空间扩散模型的元数据条件化心脏磁共振(CMR)图像生成,将结构化临床元数据和切片位置编码为文本提示,引导图像生成。为提升元数据遵循度并缓解临床属性不平衡,提出三种策略:无元数据分类器自由引导(Metadata-Free CFG)、对比批处理和逆频率采样。在包含59,058例短轴心脏核磁图像的英国生物银行数据集上进行微调与评估,采用图像相似性、分布保真度及分组分析。联合方法取得37.47的弗雷歇倒置距离(FID),较无策略微调提升57.04%,较此前需额外心脏几何信息的文本条件基线提升28.68%,且仅依赖患者元数据。该分布提升主要由元数据无关的CFG驱动,伴随适度的成对相似性下降,表明模型更关注群体层面真实性而非精确图像复现。分组分析显示在人口统计与采集相关元数据上对齐性改善,疾病特异性条件生成仍最困难。结果证明生成基础模型在临床有意义的CMR生成中的潜力,同时凸显更高效元数据感知条件策略的必要性。代码已开源。

原文摘要 · Abstract (English)

Synthetic image generation is a promising strategy to address data scarcity and the underrepresentation of clinically important phenotypes in medical imaging, yet generating images that faithfully reflect meaningful patient characteristics remains challenging. In this work, we investigate metadata-conditioned cardiac magnetic resonance (CMR) synthesis using a pretrained latent diffusion model, encoding structured clinical metadata and slice position as textual prompts to guide CMR generation. To improve metadata adherence and address the imbalance of clinical attributes, we integrate three strategies: Metadata-Free Classifier-Free Guidance (CFG), Contrastive Batching, and Inverse-Frequency Sampling. The framework was fine-tuned and evaluated on 59,058 short-axis CMR from the UK Biobank using paired image similarity, distributional fidelity, and subgroup-level analyses. The combined approach achieved a Fréchet Inception Distance (FID) of 37.47, improving by 57.04\% over the same model fine-tuned without these strategies and by 28.68\% over a previous text-conditioned CMR diffusion baseline requiring cardiac geometry as additional input, while relying solely on patient metadata. This distributional gain, driven mainly by Metadata-Free CFG, came with a modest reduction in paired similarity, suggesting that the model prioritizes population-level realism over exact image reproduction. Subgroup analyses demonstrated improved alignment across demographic and acquisition-related metadata, with disease-specific conditioning being the most challenging task. These findings demonstrate the potential of generative foundation models for clinically meaningful CMR synthesis while highlighting the need for more effective metadata-aware conditioning strategies. Our code is available at https://github.com/rodriguezmarc/conditional-cmr.

医学图像扩散模型数据生成元数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。