arXiv:2510.22778math.PRcs.LG2025-10被引 2

用自由概率论构建无噪扩散模型,统一多类不等式与算法。

Free Denoising Diffusion Models

  • 基于自由概率框架构造扩散过程,利用谱分布建模数据。
  • 推导出反向方程与显式可积性条件,支持算法实现。
  • 适合数学、机器学习交叉研究者,尤其关注理论建模者。

我们提出一种基于自由概率论的无噪扩散框架,其中数据为自伴算子,其分布为谱分布。前向过程为自由Ornstein--Uhlenbeck扩散,其谱边缘解满足由希尔伯特变换携带的复型非局部福克-普朗克方程。围绕自由能沿自由Wasserstein测地线的1-凸性展开分析,我们恢复了Biane、Hiai--Petz--Ueda及Ledoux--Popescu所提出的自由对数Sobolev、Talagrand和HWI不等式,以及耗散恒等式与自由Jordan--Kinderlehrer--Otto方案的收敛性。通过Dabrowski对自由扩散的时间反转,得到反向方程,其漂移项涉及Voiculescu的共轭变量;该变量在任意正时间下平方可积,并给出沿扩散调度的显式上界。自由Tweedie恒等式导出一致的得分匹配目标与有限维算法。对于算子值波动率,计算谱速度场,与厄米矩阵模型匹配,证明除非系数为常数,否则扩散既无谱Lamperti约化也无Wasserstein梯度流结构。进一步给出初始分布的二阶柯西核决定谱隙存活的阈值,并报告数值实验。

原文摘要 · Abstract (English)

We develop a free-probabilistic framework for denoising diffusion, in which the data is a self-adjoint operator and its law a spectral distribution. The forward process is the free Ornstein--Uhlenbeck diffusion, whose spectral marginals solve a nonlocal Fokker--Planck equation of complex Burgers type carried by the Hilbert transform. Organising the analysis around the $1$-convexity of the free energy along free Wasserstein geodesics, we recover, in the form required by the diffusion schedule, the free logarithmic Sobolev, Talagrand and HWI inequalities of Biane, Hiai--Petz--Ueda and Ledoux--Popescu, together with a dissipation identity and the convergence of a free Jordan--Kinderlehrer--Otto scheme. Specialising Dabrowski's time reversal of free diffusions, we obtain the reverse-time equation, whose drift involves Voiculescu's conjugate variable; the latter is square-integrable at every positive time, with an explicit bound along the schedule. A free Tweedie identity yields a consistent score-matching objective and a finite-dimensional algorithm. For operator-valued volatility, we compute the spectral velocity field, match it to a Hermitian matrix model, and show that the resulting diffusion admits neither a spectral Lamperti reduction nor a Wasserstein gradient-flow structure unless the coefficient is constant. We further give a threshold for the survival of a spectral gap along the flow, in terms of the second-order Cauchy kernel of the initial law, and report numerical experiments.

扩散模型自由概率理论分析分数匹配

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。