一个模型搞定图像双向转换,效率翻倍且性能更优。
Bidirectional Diffusion Bridge Models
- 用统一网络实现正反双向图像转换,利用时间可逆性减少计算开销。
- 在高分辨率任务上达到领先效果,仅需单个模型完成双向翻译。
- 适合需要高效双向生成的图像处理场景,如风格迁移、修复等。
扩散桥模型在配对图像到图像(I2I)转换任务中展现出潜力,但现有方法受限于单向特性,需分别建模正反方向,导致计算成本翻倍且实用性受限。本文提出双向扩散桥模型(BDBM),通过单一网络实现两个相关分布间的双向转换。BDBM基于桥接过程的Chapman-Kolmogorov方程,利用初始与目标时刻的可交换性,在正反两个方向上建模数据分布随时间的变化。当端点边缘分布为高斯时,其正反向转移核具有解析形式,支持高效学习。我们揭示了BDBM与Doob's h-transform及变分方法的联系,并展示了其优势。大量实验表明,BDBM在高分辨率I2I任务中不仅实现低额外开销的双向转换,还优于现有先进桥模型。代码已开源。
原文摘要 · Abstract (English)
Diffusion bridges have shown potential in paired image-to-image (I2I) translation tasks. However, existing methods are limited by their unidirectional nature, requiring separate models for forward and reverse translations. This not only doubles the computational cost but also restricts their practicality. In this work, we introduce the Bidirectional Diffusion Bridge Model (BDBM), a scalable approach that facilitates bidirectional translation between two coupled distributions using a single network. BDBM leverages the Chapman-Kolmogorov Equation for bridges, enabling it to model data distribution shifts across timesteps in both forward and backward directions by exploiting the interchangeability of the initial and target timesteps within this framework. Notably, when the marginal distribution given endpoints is Gaussian, BDBM's transition kernels in both directions possess analytical forms, allowing for efficient learning with a single network. We demonstrate the connection between BDBM and existing bridge methods, such as Doob's h-transform and variational approaches, and highlight its advantages. Extensive experiments on high-resolution I2I translation tasks demonstrate that BDBM not only enables bidirectional translation with minimal additional cost but also outperforms state-of-the-art bridge models. Our source code is available at [https://github.com/kvmduc/BDBM||https://github.com/kvmduc/BDBM].
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。