统一图像生成与超分辨率,无需换模型或重训练
Everything at Every Scale: Scale-Invariant Diffusion with Continuous Super-Resolution

- 用尺度不变的扩散过程,把不同尺度信息当作动态坐标处理
- 单个模型在CIFAR-10上达FID 2.65,ImageNet超分性能是条件模型的2到8倍
- 适合需要多尺度生成、不想调参或微调的开发者和研究者
从噪声生成图像与从粗略输入恢复细节本质上都是逆向信息损失的过程。我们提出SKILD——一种尺度不变的K空间图像学习扩散模型,将无条件图像生成与连续超分辨率统一在一个框架内。自然图像与关键物理系统均呈现尺度不变性,我们利用此特性设计前向过程:从精细到粗糙尺度逐步衰减图像内容,并注入谱匹配高斯噪声,使尺度成为扩散动态的显式坐标。相同的反向过程仅通过调整起始时间步即可实现生成与连续超分辨率,无需任务特定结构、条件分支、分类器自由引导或每种缩放因子重新训练。实验表明,SKILD在无条件CIFAR-10上达到FID 2.65和Inception Score 9.63;在ImageNet上实现2×至8×超分辨率,仅用一个无条件检查点即超越条件模型的感知指标;并准确重构临界伊辛模型的四点关联函数,接近真实值。
原文摘要 · Abstract (English)
Creating images from noise is image generation; reconstructing fine details from coarse inputs is super-resolution. Despite their practical differences, both can be understood as reversing information loss across scales. We introduce $\textbf{SKILD}$, a $\textbf{S}$cale-invariant $\textbf{K}$-Space $\textbf{I}$mage $\textbf{L}$earning $\textbf{D}$iffusion model that unifies generation and continuous super-resolution within a single unconditional framework. Both natural images and critical physical systems exhibit scale invariance, and we leverage it to design a forward process that attenuates image content from fine to coarse scales while injecting spectrum-matched Gaussian noise, making scale an explicit coordinate of the diffusion dynamics. The same trained reverse process performs generation and continuous super-resolution by varying only the starting timestep: $\textit{no task-specific architecture, no conditioning branch, no classifier-free guidance, no retraining per scale factor}$. Empirically, SKILD reaches FID $2.65$ and Inception Score $9.63$ on unconditional CIFAR-10, performs $2\times$--$8\times$ super-resolution on ImageNet from a single unconditional checkpoint while outperforming conditional models across perceptual metrics, and reconstructs critical Ising models whose connected four-point correlations closely track the ground truth.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。