用量化锚点加速扩散型薛定谔桥训练,提升效率且保持生成质量。
QDSB: Quantized Diffusion Schrödinger Bridges

- 通过锚点量化源与目标分布,构建局部耦合再升维回原始数据。
- 在真实数据集上生成质量媲美基线,训练时间显著减少。
- 适合需要快速生成模型的场景,尤其对计算资源有限者友好。
在仅能获取无配对样本的场景下,学习生成模型的重要性日益凸显。其中,薛定谔桥(SB)可表示两端分布间最可能的演化路径。为加速训练,无需路径模拟的SB避免了原始模型中的路径采样,但需配对数据——即通过熵正则最优传输(entropic OT)求解源与目标样本的耦合。然而,在实际中全局最优耦合难以获得,因此常在小批量上迭代求解,这仍带来较大开销,且局部性会扭曲全局传输几何。本文提出量化扩散薛定谔桥(QDSB),在锚点量化后的端点分布上计算端点耦合,并通过单元内采样将结果提升回原始数据点。我们证明,正则化最优耦合对锚点量化具有稳定性,误差由锚点近似质量控制。真实世界实验表明,QDSB在生成质量上达到现有基线水平,但所需时间大幅减少。代码与数据已公开于 github.com/mathefuchs/qdsb。
原文摘要 · Abstract (English)
Learning generative models in settings where the source and target distributions are only specified through unpaired samples is gaining in importance. Here, one frequently-used model are Schrödinger bridges (SB), which represent the most likely evolution between both endpoint distributions. To accelerate training, simulation-free SBs avoid the path simulation of the original SB models. However, learning simulation-free SBs requires paired data; a coupling of the source and target samples is obtained as the solution of the entropic optimal transport (OT) problem. As obtaining the optimal global coupling is infeasible in many practical cases, the entropic OT problem is iteratively solved on minibatches instead. Still, the repeated cost remains substantial and the locality can distort the global transport geometry. We propose quantized diffusion Schrödinger bridges (QDSB), which compute the endpoint coupling on anchor-quantized endpoint distributions and lift the resulting plan back to original data points through cell-wise sampling. We show that the regularized optimal coupling is stable w.r.t. anchor quantization, with an error controlled by the quality of the anchor approximation. In real-world experiments, QDSB matches the sample quality of existing baselines, requiring substantially less time. Code and data are available at github.com/mathefuchs/qdsb.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。