arXiv:2502.19754cs.CV2025-02CVPR被引 9

用KAN网络在扩散路径中找局部最优,提升图像生成质量与速度。

Finding Local Diffusion Schrödinger Bridge using Kolmogorov-Arnold Network

  • 在扩散路径子空间中优化局部路径,连接SB与扩散模型
  • 仅需不到0.1MB额外参数,FID降低超15%,NFE=5时降48.5%
  • 适合追求高效高质图像生成的开发者和研究者

在图像生成中,基于薛定谔桥(Schrödinger Bridge, SB)的方法理论上比扩散模型更高效、更高质量,因其能寻找两分布间的最低成本路径。然而,当应用于复杂图像数据时,这些方法计算成本高且耗时,原因在于其聚焦于高维空间中的全局最优路径,直接使用复杂网络通过自监督训练生成下一帧图像,通常难以逼近全局最优。同时,大多数扩散模型遵循同一路径子空间结构(x_t = f_A(t)x_Img + f_B(t)ε),由权重f_A(t)和f_B(t)生成。为解决上述问题,本文首次提出在扩散路径子空间中寻找局部扩散薛定谔桥(LDSB),强化了SB问题与扩散模型之间的联系。具体地,采用具有抗遗忘能力与连续输出特性的科尔莫戈罗夫-阿诺德网络(KAN)优化扩散路径。实验表明,使用相同预训练去噪网络,仅增加小于0.1MB的KAN参数,即可显著提升图像生成质量与效率,其中在CelebA数据集上,当DDIM的NFE为5时,FID下降48.50%,整体下降超过15%。代码已开源。

原文摘要 · Abstract (English)

In image generation, Schrödinger Bridge (SB)-based methods theoretically enhance the efficiency and quality compared to the diffusion models by finding the least costly path between two distributions. However, they are computationally expensive and time-consuming when applied to complex image data. The reason is that they focus on fitting globally optimal paths in high-dimensional spaces, directly generating images as next step on the path using complex networks through self-supervised training, which typically results in a gap with the global optimum. Meanwhile, most diffusion models are in the same path subspace generated by weights $f_A(t)$ and $f_B(t)$, as they follow the paradigm ($x_t = f_A(t)x_{Img} + f_B(t)ε$). To address the limitations of SB-based methods, this paper proposes for the first time to find local Diffusion Schrödinger Bridges (LDSB) in the diffusion path subspace, which strengthens the connection between the SB problem and diffusion models. Specifically, our method optimizes the diffusion paths using Kolmogorov-Arnold Network (KAN), which has the advantage of resistance to forgetting and continuous output. The experiment shows that our LDSB significantly improves the quality and efficiency of image generation using the same pre-trained denoising network and the KAN for optimising is only less than 0.1MB. The FID metric is reduced by more than 15\%, especially with a reduction of 48.50\% when NFE of DDIM is $5$ for the CelebA dataset. Code is available at https://github.com/PerceptionComputingLab/LDSB.

图像生成扩散模型薛定谔桥KAN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。