arXiv:2503.05339eess.IVcs.CV2025-03

用对抗学习从低场磁共振生成高场图像,提升数据质量用于下游任务

Pretext Task Adversarial Learning for Unpaired Low-field to Ultra High-field MRI Synthesis

  • 通过对比学习对齐高低场切片差异,解决图像域间不一致问题
  • 利用局部结构修复和预训练任务提升细节还原度,生成更真实图像
  • 适合医学影像数据增强、小样本场景下的模型训练应用

由于高场磁共振扫描成本高且数据稀缺,从低场磁共振合成高场图像在下游任务(如分割)数据有限时具有重要意义。低场图像普遍存在信噪比低、空间分辨率差的问题。现有方法在跨域特征对齐、解剖结构准确性保持及细粒度细节增强方面面临挑战。为此,我们提出一种无配对的预训练任务对抗学习框架(PTA),包含三个模块:(1) 切片级间隙感知网络(SGP)基于对比学习对齐高低场数据的切片不一致性;(2) 局部结构校正网络(LSC)通过恢复局部旋转与掩码图像来提取局部结构;(3) 预训练任务引导的对抗训练引入额外监督并结合判别器提升图像真实性。在低场到超高场磁共振合成任务上,本方法达到当前最优性能(FID: 16.892,IS: 1.933,MS-SSIM: 0.324),可有效生成高质量类高场磁共振数据,用于下游任务的数据增强。代码已开源。

原文摘要 · Abstract (English)

Given the scarcity and cost of high-field MRI, the synthesis of high-field MRI from low-field MRI holds significant potential when there is limited data for training downstream tasks (e.g. segmentation). Low-field MRI often suffers from a reduced signal-to-noise ratio (SNR) and spatial resolution compared to high-field MRI. However, synthesizing high-field MRI data presents challenges. These involve aligning image features across domains while preserving anatomical accuracy and enhancing fine details. To address these challenges, we propose a Pretext Task Adversarial (PTA) learning framework for high-field MRI synthesis from low-field MRI data. The framework comprises three processes: (1) The slice-wise gap perception (SGP) network aligns the slice inconsistencies of low-field and high-field datasets based on contrastive learning. (2) The local structure correction (LSC) network extracts local structures by restoring the locally rotated and masked images. (3) The pretext task-guided adversarial training process introduces additional supervision and incorporates a discriminator to improve image realism. Extensive experiments on low-field to ultra high-field task demonstrate the effectiveness of our method, achieving state-of-the-art performance (16.892 in FID, 1.933 in IS, and 0.324 in MS-SSIM). This enables the generation of high-quality high-field-like MRI data from low-field MRI data to augment training datasets for downstream tasks. The code is available at: https://github.com/Zhenxuan-Zhang/PTA4Unpaired_HF_MRI_SYN.

MRI合成对抗学习医学图像数据增强

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。