用损坏数据训练生成模型,让模型学会还原真实图像。
Score Distillation Beyond Acceleration: Generative Modeling from Corrupted Data
- 通过预训练去污扩散模型,再蒸馏成一步生成器
- 在多个数据集上比原模型降低FID,速度提升30倍
- 适合无干净图像时的图像生成与修复任务
从损坏观测中直接学习生成模型是自然与科学领域长期存在的挑战。本文提出恢复评分蒸馏(RSD),一种统一框架,仅使用退化数据和退化映射 $A$(可为恒等或不可逆退化算子,如模糊、掩码、下采样、傅里叶采集)来学习高质量的一步生成模型。RSD 先在观测数据上预训练一个感知退化的扩散教师模型,再将其评分蒸馏到高效的一步生成器中,使生成样本更接近真实分布 $p_X$。该框架将恒等退化(去噪任务)作为特例纳入统一形式。实验表明,RSD 在噪声生成(CIFAR-10、FFHQ、CelebA HQ、AFHQ v2)、图像修复(高斯去模糊、随机填孔、超分辨率及加性噪声混合)和多线圈MRI中,均在无任何干净图像的情况下,持续降低弗雷切特图像距离(FID)。蒸馏生成器继承一步采样效率,相比多步扩散模型提速最高达30倍,且在远少于训练迭代次数后超越教师模型。这些结果确立了评分蒸馏不仅是加速工具,更是从损坏数据中进行生成建模的实用方法。附录提供了蒸馏提升生成质量的理论支持。
原文摘要 · Abstract (English)
Learning generative models directly from corrupted observations is a long standing challenge across natural and scientific domains. We introduce Restoration Score Distillation (RSD), a unified framework for learning high fidelity, one step generative models using only degraded data and the mapping $A$ may be the identity or a non invertible corruption operator (e.g., blur, masking, subsampling, Fourier acquisition). RSD first pretrains a corruption aware diffusion teacher on the observed measurements, then distills it into an efficient one step generator whose samples are statistically closer to the clean distribution p_X. The framework subsumes identity corruption (denoising task) as a special case of our general formulation. Empirically, RSD consistently reduces Frechet Inception Distance (FID) relative to corruption aware diffusion teachers across noisy generation (CIFAR 10, FFHQ, CelebA HQ, AFHQ v2), image restoration (Gaussian deblurring, random inpainting, super resolution, and mixtures with additive noise), and multi coil MRI without access to any clean images. The distilled generator inherits one step sampling efficiency, yielding up to 30x speedups over multi step diffusion while surpassing the teachers after substantially fewer training iterations. These results establish score distillation as a practical tool for generative modeling from corrupted data, not merely for acceleration. We provide theoretical support for the use of distillation in enhancing generation quality in the Appendix.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。