arXiv:2607.06841stat.MLcs.LG2026-07

用低秩张量结构加速高维得分采样,提升扩散模型效率与稳定性。

Tensor Train Diffusion: Leveraging Low-Rank Structures for High-Dimensional Score-Based Sampling

论文配图:Tensor Train Diffusion: Leveraging Low-Rank Structures for High-Dimensional Score-Based Sampling
图 1 · 摘自论文原文
  • 基于函数张量列车(FTT)表示,利用低秩结构高效逼近高维函数
  • 结合反向随机微分方程的迭代算法,实现快速精准采样
  • 相比传统方法训练更快、对超参数不敏感,适合复杂分布采样

扩散模型通过学习逆向加噪过程来从复杂概率密度中采样。通常需求解时间反演的随机微分方程(SDE),这依赖于演化样本分布的得分函数。该分布密度的对数满足一类哈密顿-雅可比-贝尔曼(HJB)型偏微分方程(PDE)。现有求解方法如物理信息神经网络(PINNs)或基于轨迹的技术常存在训练耗时长、对超参数敏感等问题。本文提出一种基于函数张量列车(FTT)格式的新颖高效求解器。FTT利用潜在低秩结构,有效逼近高维函数,实现模型压缩与快速计算。通过将此高效表示与源自反向随机微分方程(BSDEs)的反向时间迭代方案结合,我们开发出一种快速、鲁棒且准确的采样方法。该方法克服了现有技术的主要瓶颈,在提高效率的同时,实现了对挑战性目标分布的高保真采样。

原文摘要 · Abstract (English)

Diffusion models offer a powerful framework for sampling from complex probability densities by learning to reverse a noising process. A common approach involves solving for the time-reversed stochastic differential equation (SDE), which requires the score function of the evolving sample distribution. The logarithm of this distribution's density is governed by a Hamilton-Jacobi-Bellman (HJB) type partial differential equation (PDE). However, current methods for solving this PDE, such as PINNs or trajectory-based techniques, often suffer from long training times and significant sensitivity to hyperparameter tuning. In this work, we introduce a novel and efficient solver for the underlying HJB equation based on the functional tensor train (FTT) format. The FTT representation leverages latent low-rank structures to efficiently approximate high-dimensional functions, enabling both model compression and rapid computation. By integrating this efficient representation with a backward-in-time iterative scheme derived from backward stochastic differential equations (BSDEs), we develop a fast, robust and accurate sampling method. Our approach overcomes primary bottlenecks of existing techniques, enabling high-fidelity sampling from challenging target distributions with improved efficiency.

扩散模型张量分解得分采样高维建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。