用弗雷谢距离损失提升肿瘤图像生成质量,减少分割幻觉。
Improving Medical Image Generative Models with Fréchet Distance Loss

- 引入弗雷谢距离损失,对齐真实与生成图像的特征统计。
- 在肝癌和脑癌数据集上,肿瘤分割Dice提升超5%。
- 适合需要高质量合成医学图像的研究者使用。
扩散生成模型在合成医学图像方面展现出巨大潜力,但难以捕捉异质性肿瘤不规则边界等复杂形态特征,限制了其在分割等下游任务中的应用。根源在于标准去噪目标最小化像素级误差,导致高方差不规则结构被平滑。为此,我们提出使用弗雷谢距离损失(FD-loss)微调生成模型。该损失在预训练编码器空间中对齐真实与生成图像的一阶和二阶特征统计,促使生成器捕捉异质性肿瘤的复杂结构变化。我们在多种架构设置下集成FD-loss,采用自然图像与医学图像编码器,在涵盖CT和MRI模态的多个肝癌和脑癌数据集上验证。基于FD正则化合成数据训练的下游分割网络表现更优,肿瘤Dice系数较未正则化合成增强提升超过5%。定性分析表明,性能提升源于更真实的肿瘤生成和更少的分割幻觉。结果表明,FD-loss是提升医学图像生成模型临床实用性的有效正则化手段。
原文摘要 · Abstract (English)
Diffusion generative models have demonstrated immense potential for synthetic medical image generation. However, these models often struggle to capture complex morphological characteristics of heterogeneous tumors with irregular boundaries, limiting their utility for downstream clinical tasks such as segmentation. This limitation stems from the standard denoising objective: minimizing a per-pixel error, which smooths high-variance irregular structures characteristic of tumors. To address this, we propose finetuning these generative models with Fréchet Distance loss (FD-loss). FD-loss aligns the first and second order feature statistics of real and generated images in a pretrained encoder space, encouraging the generator to capture complex structural variations characteristic of heterogeneous tumors. We integrate FD-loss across diverse architectural settings, using both natural- and medical-image encoders on multiple liver and brain cancer datasets spanning CT and MRI modalities. Downstream segmentation networks trained on our FD-regularized synthetic data consistently achieve superior performance, improving tumor DSC by $>$$5\%$ over unregularized synthetic augmentation alone. Qualitative analysis suggests these gains are associated with more faithful tumor synthesis and fewer segmentation hallucinations. Our results show FD-loss as an effective regularizer for medical image generative models to improve clinical workflows.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。