部署后迭代修正生成误差,提升高效扩散模型画质
Test-Time Iterative Error Correction for Efficient Diffusion Models
- 部署时迭代优化输出,纠正效率技术引入的误差
- 误差传播从指数增长变为线性,画质显著提升
- 无需重训练,适配各类高效扩散模型
随着资源受限设备对高质量图像生成需求增加,高效扩散模型受到广泛关注。然而,此类模型因效率技术引入近似误差,严重降低生成质量。一旦部署,模型修改通常不可行,误差难以修正。通过分析扩散过程中的误差传播,我们发现这些近似误差会呈指数累积,严重影响输出质量。受此启发,提出测试时迭代误差修正(IEC)方法,通过迭代细化模型输出,有效缓解推理误差。理论证明,IEC可将误差传播从指数级降至线性级,且无需重训练或架构改动。该方法可无缝集成至现有扩散模型推理流程,实现性能与效率的灵活权衡。大量实验表明,IEC在多种数据集、效率技术及模型架构下均持续提升生成质量,是高效扩散模型测试时增强的实用通用方案。代码已开源:https://github.com/zysxmu/IEC。
原文摘要 · Abstract (English)
With the growing demand for high-quality image generation on resource-constrained devices, efficient diffusion models have received increasing attention. However, such models suffer from approximation errors introduced by efficiency techniques, which significantly degrade generation quality. Once deployed, these errors are difficult to correct, as modifying the model is typically infeasible in deployment environments. Through an analysis of error propagation across diffusion timesteps, we reveal that these approximation errors can accumulate exponentially, severely impairing output quality. Motivated by this insight, we propose Iterative Error Correction (IEC), a novel test-time method that mitigates inference-time errors by iteratively refining the model's output. IEC is theoretically proven to reduce error propagation from exponential to linear growth, without requiring any retraining or architectural changes. IEC can seamlessly integrate into the inference process of existing diffusion models, enabling a flexible trade-off between performance and efficiency. Extensive experiments show that IEC consistently improves generation quality across various datasets, efficiency techniques, and model architectures, establishing it as a practical and generalizable solution for test-time enhancement of efficient diffusion models. The code is available in https://github.com/zysxmu/IEC.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。