用医学领域预训练模型提升脑部MRI低剂量模拟的视觉质量
Medical Foundation Model Features as Perceptual Loss for Brain MRI Contrast Dose Simulation

- 用医疗领域模型替代传统VGG/ResNet做感知损失特征提取
- 在脑MRI剂量模拟中,结构相似性与残差增强显著改善
- 适合医学图像生成、低剂量成像优化的研究者参考
感知损失广泛用于医学图像合成,以促进高层结构一致性。但现有方法多采用自然图像预训练的VGG16或ResNet50作为特征提取器,即使目标域为磁共振成像(MRI),仍可能削弱对解剖结构、对比度增强和采集变异性的监督。本文测试医疗基础模型特征是否更适合作为脑部MRI对比剂剂量模拟的感知损失。研究分两阶段:第一阶段,在甲状腺超声、乳腺超声、前交叉韧带膝关节MRI和半月板膝关节MRI四个公开数据集上,比较RadImageNet、SegVol、BrainIAC与ImageNet预训练的VGG16和ResNet50作为冻结特征提取器的表现;RadImageNet在代表性能排名最低,被选为ϕ⋆。第二阶段,将现有迭代式脑部MRI剂量模拟框架中的VGG16特征提取器替换为ϕ⋆,其余模块如生成器、重建损失、对抗损失、辅助损失、优化策略和权重均保持不变。标准指标略有提升:PSNR从41.63升至41.74,SSIM从0.9739增至0.9754,RMSE从0.1384降至0.1369,残差摄取信噪比(CNR)从0.0085降至0.0082。视觉结果表明,使用RadImageNet可减少标记结构中的残留增强,更准确地遵循剂量降低轨迹,并更接近10%低剂量目标。结果支持使用领域对齐的放射学特征作为MRI剂量模拟的实用感知特征空间,临床等效性及大样本验证尚待后续工作。
原文摘要 · Abstract (English)
Perceptual losses are widely used in medical image synthesis because they encourage agreement in high-level structure beyond voxel-wise intensity similarity. In practice, most perceptual losses are still computed with natural-image backbones such as VGG16 or ResNet50, even when the target domain is magnetic resonance imaging (MRI). This mismatch may weaken supervision for anatomy, contrast enhancement, and acquisition variability. We test whether medical foundation model features provide a more suitable perceptual loss for brain MRI contrast dose simulation. The study has two stages. First, we compare RadImageNet, SegVol, and BrainIAC with ImageNet-pretrained VGG16 and ResNet50 as frozen feature extractors on four public medical imaging benchmarks: thyroid ultrasound, breast ultrasound, anterior cruciate ligament knee MRI, and meniscus knee MRI. RadImageNet achieves the lowest mean rank across the Stage I representation suite and is selected as $ϕ^\star$. Second, we replace only the VGG16 feature extractor in an existing iterative brain MRI dose simulation framework with $ϕ^\star$. The generator, reconstruction loss, adversarial loss, auxiliary losses, optimization schedule, and loss weights are kept unchanged. Standard metrics change modestly, with PSNR increasing from 41.63 to 41.74, SSIM from 0.9739 to 0.9754, RMSE decreasing from 0.1384 to 0.1369, and residual-uptake CNR from 0.0085 to 0.0082. The visual results show the main effect: RadImageNet reduces residual enhancement in marked structures, follows a more faithful dose-reduction trajectory, and remains close to the acquired 10% low-dose target. These results support domain-aligned radiology features as a practical perceptual feature space for MRI dose simulation, while leaving clinical equivalence and larger-cohort validation as future work.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。