arXiv:2606.03578cs.CV2026-06被引 2

探究潜在空间扩散性能,发现新指标可稳定预测生成质量。

Diffusing in the Right Space: A Systematic Study of Latent Diffusability

论文配图:Diffusing in the Right Space: A Systematic Study of Latent Diffusability
图 1 · 摘自论文原文
  • 系统训练多种编码器,测试不同潜在表示的扩散能力。
  • 新指标VIV能稳定预测生成质量,优于现有评估方法。
  • 适合关注生成模型潜空间设计的研究者和工程师。

潜在扩散模型通过视觉分词器将图像压缩至潜在空间以实现高效生成。然而,分词器重建质量越高,生成质量未必越好,表明潜在表示需同时考虑保真度与可扩散性。已有研究提出语义分离性、仿射等变性、分布均匀性、空间结构、频谱平滑性及流形连续性等属性作为扩散友好潜在空间的解释。但这些性质多在有限分词器上验证,其对下游生成质量的预测能力及泛化性尚不明确。本文系统研究潜在可扩散性,训练大量具有不同正则化策略、架构与潜在配置的分词器,并在多个下游扩散模型上评估其表现。分析发现若干潜在属性在不同设置下均与生成质量显著相关且具有良好泛化性。此外,提出新指标速度不可约方差(VIV),衡量轨迹交叉引发的速度模糊性。大量实验表明,VIV是生成质量最稳定的预测指标之一。

原文摘要 · Abstract (English)

Latent diffusion models leverage visual tokenizers to compress images into latent spaces for efficient generative modeling. However, better reconstruction quality of a tokenizer does not necessarily translate into better generation quality, suggesting that latent representations should be evaluated not only by fidelity but also by their diffusability. Recent studies have proposed diverse explanations for diffusion-friendly latent spaces, including semantic separability, affine equivariance, distribution uniformity, spatial structure, spectral smoothness, and manifold continuity. Yet these properties are often validated on a limited set of tokenizers, leaving it unclear which factors are most predictive of downstream generation quality and whether such conclusions hold beyond the specific settings in which they are introduced. In this work, we conduct a systematic study of latent diffusability by training a large collection of tokenizers with diverse regularization strategies, architectures, and latent configurations, and evaluating them with multiple downstream diffusion backbones. Our analysis identifies several latent properties that consistently correlate with generation quality and exhibit strong generalization across experimental settings. Beyond existing metrics, we introduce Velocity Irreducible Variance (VIV), a measure of velocity ambiguity induced by trajectory crossings. Extensive experiments show that VIV is one of the most stable predictors of generation quality.

扩散模型潜在空间生成质量量化评估

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。