arXiv:2604.19736cs.CV2026-04被引 1

提出GDM框架,让3D医学图像生成更快更准更真实。

Generative Drifting for Conditional Medical Image Generation

论文配图:Generative Drifting for Conditional Medical Image Generation
图 1 · 摘自论文原文
  • 用双向漂移机制同时优化图像真实性和患者特异性
  • 在磁共振转CT和稀疏视角重建任务上超越多种主流模型
  • 适合需要快速高保真生成的临床影像应用

条件医学图像生成在临床成像任务中至关重要,但现有方法难以兼顾推理效率、患者特异性保真度与分布合理性,尤其在高维3D医学影像中。本文提出GDM框架,将确定性医学图像预测重构为多目标学习问题,联合提升分布合理性与患者特异性保真度,同时保持单步推理。GDM通过吸引-排斥漂移机制,最小化生成器推送分布与目标分布间的差异,并构建多层级特征库,基于医学基础编码器支持全局、局部与空间表征下的可靠亲和性估计与漂移场计算。此外,共享输出空间中的梯度协调策略,在分布级与保真度目标间实现优化平衡。我们在两个代表性任务上评估:MRI-to-CT合成与稀疏视角CT重建。结果表明,GDM持续优于多种基线模型(包括GAN、流匹配、SDE及监督回归方法),在解剖保真度、定量可靠性、感知真实性与推理效率之间取得更好平衡。这些发现表明GDM为条件3D医学图像生成提供了一种实用有效的框架。

原文摘要 · Abstract (English)

Conditional medical image generation plays an important role in many clinically relevant imaging tasks. However, existing methods still face a fundamental challenge in balancing inference efficiency, patient-specific fidelity, and distribution-level plausibility, particularly in high-dimensional 3D medical imaging. In this work, we propose GDM, a generative drifting framework that reformulates deterministic medical image prediction as a multi-objective learning problem to jointly promote distribution-level plausibility and patient-specific fidelity while retaining one-step inference. GDM extends drifting to 3D medical imaging through an attractive-repulsive drift that minimizes the discrepancy between the generator pushforward and the target distribution. To enable stable drifting-based learning in 3D volumetric data, GDM constructs a multi-level feature bank from a medical foundation encoder to support reliable affinity estimation and drifting field computation across complementary global, local, and spatial representations. In addition, a gradient coordination strategy in the shared output space improves optimization balance under competing distribution-level and fidelity-oriented objectives. We evaluate the proposed framework on two representative tasks, MRI-to-CT synthesis and sparse-view CT reconstruction. Experimental results show that GDM consistently outperforms a wide range of baselines, including GAN-based, flow-matching-based, and SDE-based generative models, as well as supervised regression methods, while improving the balance among anatomical fidelity, quantitative reliability, perceptual realism, and inference efficiency. These findings suggest that GDM provides a practical and effective framework for conditional 3D medical image generation.

医学图像生成3D生成条件生成扩散模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。