提出APT框架,让扩散模型生成更高清图像更清晰更快。
APT: Improving Diffusion Models for High Resolution Image Generation with Adaptive Path Tracing
- 用自适应路径追踪融合补丁,保持高分辨率潜空间分布一致
- 在1024×1024图像上细节更清晰,采样速度提升30%以上
- 适合追求高质量、低延迟高分辨率生成的开发者使用
潜在扩散模型(LDM)通常在固定分辨率下训练,限制了其在高分辨率图像生成中的能力。虽然基于训练的方法可通过高分辨率数据集缓解此问题,但需大量数据和计算资源,不够实用。因此,无需训练的补丁方法成为主流,它们将图像分块并融合各块去噪路径,在高分辨率生成中表现良好。然而我们发现两类关键问题:'补丁级分布偏移'与'补丁单调性增强'。为此,我们提出自适应路径追踪(APT),结合统计匹配确保上采样潜空间中补丁分布一致,并采用尺度感知调度解决补丁单调性问题。结果,APT生成的图像细节更清晰、更精细。此外,APT支持捷径去噪流程,实现更快采样且质量损失极小。实验表明,APT在1024×1024图像生成中显著提升细节表现与推理速度,提供了一种实用的高分辨率图像生成方案。
原文摘要 · Abstract (English)
Latent Diffusion Models (LDMs) are generally trained at fixed resolutions, limiting their capability when scaling up to high-resolution images. While training-based approaches address this limitation by training on high-resolution datasets, they require large amounts of data and considerable computational resources, making them less practical. Consequently, training-free methods, particularly patch-based approaches, have become a popular alternative. These methods divide an image into patches and fuse the denoising paths of each patch, showing strong performance on high-resolution generation. However, we observe two critical issues for patch-based approaches, which we call ``patch-level distribution shift" and ``increased patch monotonicity." To address these issues, we propose Adaptive Path Tracing (APT), a framework that combines Statistical Matching to ensure patch distributions remain consistent in upsampled latents and Scale-aware Scheduling to deal with the patch monotonicity. As a result, APT produces clearer and more refined details in high-resolution images. In addition, APT enables a shortcut denoising process, resulting in faster sampling with minimal quality degradation. Our experimental results confirm that APT produces more detailed outputs with improved inference speed, providing a practical approach to high-resolution image generation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。