通过分层保体积映射,让级联扩散模型实现可计算的似然估计。
Likelihood Training of Cascaded Diffusion Models via Hierarchical Volume-preserving Maps
- 用分层保体积映射重构潜空间,消除多尺度生成中的不可计算似然问题。
- 在密度估计、无损压缩等任务上超越当前最优基准,提升显著。
- 适用于需要精确似然建模的场景,如异常检测与生成模型评估。
级联模型是具有强大高分辨率感知生成能力的多尺度生成模型。本文表明,只要克服概率多尺度模型的根本难题——似然函数不可计算性,这类模型也可成为出色的似然模型。关键在于:级联模型中每一中间尺度引入的额外变量难以有效边缘化以进行似然评估。该问题可通过在由一类称为分层保体积映射的变换诱导的潜空间中建模扩散过程来解决,这类映射能分层分解空间结构数据,且不引入潜空间的局部畸变。我们证明,拉普拉斯金字塔和小波变换正是文献中已知的两种此类映射。不仅使似然函数可直接表示为各尺度的联合似然,还发现这两种重参数化在密度估计、无损压缩和分布外检测等多个基准任务上带来显著性能提升。进一步分析理论基础揭示其与地球移动距离(EMD)下的得分匹配存在深层关联,而EMD是感知相似性的经典代理指标。代码见 https://github.com/lihenryhfl/pcdm。
原文摘要 · Abstract (English)
Cascaded models are multi-scale generative models with a marked capacity for producing perceptually impressive samples at high resolutions. In this work, we show that they can also be excellent likelihood models, so long as we overcome a fundamental difficulty with probabilistic multi-scale models: the intractability of the likelihood function. Chiefly, in cascaded models each intermediary scale introduces extraneous variables that cannot be tractably marginalized out for likelihood evaluation. This issue vanishes by modeling the diffusion process on latent spaces induced by a class of transformations we call hierarchical volume-preserving maps, which decompose spatially structured data in a hierarchical fashion without introducing local distortions in the latent space. We demonstrate that two such maps are well-known in the literature for multiscale modeling: Laplacian pyramids and wavelet transforms. Not only do such reparameterizations allow the likelihood function to be directly expressed as a joint likelihood over the scales, we show that the Laplacian pyramid and wavelet transform also produces significant improvements to the state-of-the-art on a selection of benchmarks in likelihood modeling, including density estimation, lossless compression, and out-of-distribution detection. Investigating the theoretical basis of our empirical gains we uncover deep connections to score matching under the Earth Mover's Distance (EMD), which is a well-known surrogate for perceptual similarity. Code can be found at \href{https://github.com/lihenryhfl/pcdm}{this https url}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。