arXiv:2608.21885cs.CV2026-08

提出新型像素扩散模型,让图像从粗到细逐步生成,提升训练速度与质量。

Pixel-Space Diffusion via Observation Operators

论文配图:Pixel-Space Diffusion via Observation Operators
图 1 · 摘自论文原文
  • 用多尺度观测轨迹替代固定全图监督,匹配图像结构恢复顺序。
  • 在ImageNet-256上达到1.52的FID,收敛更快、生成质量更优。
  • 适合关注高效图像生成与扩散模型优化的研究者。

像素空间扩散模型直接建模图像分布,但优化困难。现有方法虽通过目标重参数化缓解问题,但仍依赖全程固定的清晰图像目标。我们通过实证分析发现:随着噪声降低,图像结构从粗到细变得可预测,而现有模型在高噪声时仍需预测完整图像,导致信噪比低的梯度,阻碍优化。为此,提出观测算子扩散(Observation Operator Diffusion)框架,将监督轨迹与特征细化过程对齐于图像结构的内在恢复顺序。具体地,以随时间变化的多尺度观测轨迹取代标准流程中的固定全图监督,该轨迹由不同尺度的高斯-兰克茨算子构成,实现路径一致的训练目标。进一步引入GL-CoDA解码器,在解码各阶段注入特定尺度的高斯-兰克茨观测,实现从粗到精的特征细化。大量实验表明,该方法显著加速收敛,持续提升生成质量,在ImageNet-256上取得1.52的FID。

原文摘要 · Abstract (English)

Pixel-space diffusion models directly model image distributions but remain difficult to optimize. Recent methods alleviate this challenge through target reparameterization, while still relying on a fixed clean-image target throughout denoising. Through empirical analysis, we identify a scale-time mismatch: image structures become predictable from coarse to fine as noise decreases, whereas existing models are forced to predict the full image even under high noise, resulting in low-SNR gradients that hinder optimization. To resolve this mismatch, we propose Observation Operator Diffusion, a unified framework that aligns both the supervision trajectory and feature refinement with the intrinsic recovery order of image structures. Specifically, we replace fixed full-image supervision along the standard flow path with a time-indexed observation trajectory that evolves from coarse structures to the full image during denoising. This trajectory is instantiated with a family of Gaussian-Lanczos operators at varying observation scales, yielding a path-consistent training objective. We further introduce GL-CoDA, a decoder that injects scale-specific Gaussian-Lanczos observations across decoding stages for coarse-to-fine feature refinement. Extensive experiments show that the proposed approach converges substantially faster while consistently improving generation quality, achieving an FID of 1.52 on ImageNet-256.

扩散模型图像生成像素空间多尺度

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。