arXiv:2511.11162cs.CVcs.AI2025-11

用最优传输对齐潜在分布,加速图像翻译并提升质量

OT-ALD: Aligning Latent Distributions with Optimal Transport for Accelerated Image-to-Image Translation

  • 基于最优传输理论对齐源域与目标域潜在分布
  • 采样效率提升20.29%,FID均值降低2.6
  • 适合需要快速高质量图像转换的研究者

双扩散隐式桥(DDIB)是一种新兴的图像到图像(I2I)翻译方法,在保持循环一致性的同时具备强灵活性。它通过将源域图像加噪得到潜在编码,再在目标域中去噪生成翻译图像,实现两独立训练扩散模型的连接。然而该方法存在两大挑战:(1) 翻译效率低;(2) 因潜在分布不匹配导致的翻译轨迹偏差。为此,我们提出一种新框架OT-ALD,基于最优传输(OT)理论,保留了DDIB方法的优势。具体而言,计算从源域潜在分布到目标域潜在分布的OT映射,并以映射后的分布作为目标域反向扩散过程的起始点。误差分析表明,OT-ALD消除了潜在分布不匹配问题。此外,OT-ALD有效平衡了更快的图像生成速度与更优的图像质量。在三个高分辨率数据集上的四个翻译任务实验表明,相较于最先进基线模型,OT-ALD平均采样效率提升20.29%,FID分数降低2.6。

原文摘要 · Abstract (English)

The Dual Diffusion Implicit Bridge (DDIB) is an emerging image-to-image (I2I) translation method that preserves cycle consistency while achieving strong flexibility. It links two independently trained diffusion models (DMs) in the source and target domains by first adding noise to a source image to obtain a latent code, then denoising it in the target domain to generate the translated image. However, this method faces two key challenges: (1) low translation efficiency, and (2) translation trajectory deviations caused by mismatched latent distributions. To address these issues, we propose a novel I2I translation framework, OT-ALD, grounded in optimal transport (OT) theory, which retains the strengths of DDIB-based approach. Specifically, we compute an OT map from the latent distribution of the source domain to that of the target domain, and use the mapped distribution as the starting point for the reverse diffusion process in the target domain. Our error analysis confirms that OT-ALD eliminates latent distribution mismatches. Moreover, OT-ALD effectively balances faster image translation with improved image quality. Experiments on four translation tasks across three high-resolution datasets show that OT-ALD improves sampling efficiency by 20.29% and reduces the FID score by 2.6 on average compared to the top-performing baseline models.

图像翻译扩散模型最优传输

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。