arXiv:2510.20766cs.CV2025-10被引 15

让扩散模型生成超高清图像,无需额外计算成本

DyPE: Dynamic Position Extrapolation for Ultra High Resolution Diffusion

  • 通过动态调整位置编码,匹配生成过程的频谱变化
  • 在1600万像素分辨率下仍保持高质量生成,超越训练分辨率
  • 无需重新训练,适合需要超高清输出的研究与应用

扩散变换器模型可生成高保真度和细节丰富的图像,但因其自注意力机制随图像标记数量呈二次增长,训练超高清图像仍极耗资源。本文提出一种无需训练的动态位置外推方法(DyPE),使预训练扩散变换器能在远超训练分辨率的情况下生成图像,且无额外采样开销。DyPE利用扩散过程中的固有频谱特性:低频结构早期收敛,高频需更多步骤才能解析。它在每个扩散步骤动态调整模型的位置编码,使其频率谱与当前生成阶段相匹配。该方法可实现大幅超越训练分辨率的图像生成,例如使用FLUX模型生成1600万像素图像。在多个基准测试中,DyPE性能持续提升,尤其在更高分辨率下表现更优,达到当前最优保真度。项目主页见https://noamissachar.github.io/DyPE/。

原文摘要 · Abstract (English)

Diffusion Transformer models can generate images with remarkable fidelity and detail, yet training them at ultra-high resolutions remains extremely costly due to the self-attention mechanism's quadratic scaling with the number of image tokens. In this paper, we introduce Dynamic Position Extrapolation (DyPE), a novel, training-free method that enables pre-trained diffusion transformers to synthesize images at resolutions far beyond their training data, with no additional sampling cost. DyPE takes advantage of the spectral progression inherent to the diffusion process, where low-frequency structures converge early, while high-frequencies take more steps to resolve. Specifically, DyPE dynamically adjusts the model's positional encoding at each diffusion step, matching their frequency spectrum with the current stage of the generative process. This approach allows us to generate images at resolutions that exceed the training resolution dramatically, e.g., 16 million pixels using FLUX. On multiple benchmarks, DyPE consistently improves performance and achieves state-of-the-art fidelity in ultra-high-resolution image generation, with gains becoming even more pronounced at higher resolutions. Project page is available at https://noamissachar.github.io/DyPE/.

扩散模型超高清生成位置编码

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。