arXiv:2605.07253cs.CV2026-05被引 1

通过低频噪声调控,实现高效图像生成且不降质。

LENS: Low-Frequency Eigen Noise Shaping for Efficient Diffusion Sampling

论文配图:LENS: Low-Frequency Eigen Noise Shaping for Efficient Diffusion Sampling
图 1 · 摘自论文原文
  • 仅在低维低频子空间调节噪声,降低计算负担。
  • 相比以往方法,推理耗时减少10-20倍,模型参数缩小25-75倍。
  • 适合追求快速生成且对质量要求高的应用落地场景。

蒸馏扩散模型通过减少去噪步骤加速图像生成,但常导致图像质量下降。测试时优化虽可提升质量,但迭代过程计算开销大,推理缓慢。近期基于超网络的方法将优化过程训练阶段摊销,但仍需在高维潜在空间进行昂贵的噪声调制。本文提出LENS(Low-frequency Eigen Noise Shaping),一种在低维子空间中操作的高效噪声调制框架。基于低频噪声主导图像全局结构与视觉保真度的观察,我们给出理论依据,并推导出合理训练目标。LENS采用轻量级独立网络,仅对低频成分进行选择性调制,实现高效精准的噪声控制。大量实验表明,相比先前方法,LENS在保持竞争性图像质量的同时,降低400–700× FLOPs,模型参数减少25–75×,推理开销下降10–20×。

原文摘要 · Abstract (English)

Distilled diffusion models accelerate image generation by reducing the number of denoising steps, but often suffer from degraded image quality. To mitigate this trade-off, test-time optimization methods improve quality, yet their iterative nature incurs substantial computational overhead and leads to slow inference, limiting practical usability. Recent hypernetwork-based approaches amortize this process during training, but still require costly noise modulation in high-dimensional latent spaces. In this work, we propose LENS (Low-frequency Eigen Noise Shaping), an efficient noise modulation framework that operates in a low-dimensional subspace. Our approach is motivated by the observation that low-frequency components of the noise largely determine the global structure and visual fidelity of generated images. Based on this observation, we provide a theoretical justification for restricting modulation to the low-frequency subspace and derive a principled training objective. Building on this, LENS employs a lightweight, standalone network to selectively modulate these components, enabling efficient and targeted noise modulation. Extensive experiments demonstrate that LENS achieves competitive image quality while reducing FLOPs by 400-700$\times$, model parameters by 25-75$\times$, and inference-time overhead by 10-20$\times$ compared to prior methods.

扩散模型高效生成噪声调制低频特征

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。