arXiv:2509.01421cs.CV2025-09被引 2

无需训练即可生成任意尺寸图像,解决分辨率变化时信息丢失问题。

InfoScale: Unleashing Training-free Variable-scaled Image Generation via Effective Utilization of Information

论文配图:InfoScale: Unleashing Training-free Variable-scaled Image Generation via Effective Utilization of Information
图 1 · 摘自论文原文
  • 从信息角度重构扩散模型,优化卷积、注意力和初始噪声
  • 在1024×1024图像生成上提升3.2分(FID)
  • 可直接接入现有模型,适合多尺度生成场景

扩散模型在视觉生成中占据主导地位,但在测试分辨率与训练不一致时性能显著下降。核心挑战在于不同分辨率间信息量差异,需动态调整信息转换机制。本文针对三个关键问题进行统一分析:1)高分辨率生成中空洞卷积丢失高频信息;2)注意力机制难以自适应调节信息聚合;3)初始噪声的空间信息分布与目标分辨率不匹配。为此,提出信息中心框架InfoScale:引入渐进式频率补偿模块,恢复空洞卷积导致的高频损失;设计自适应信息聚合模块,实现低分辨率下局部与高分辨率下全局信息的平衡;提出噪声适配模块,重新分布初始噪声中的信息。方法可即插即用,广泛实验验证其在多尺度图像生成上的有效性。

原文摘要 · Abstract (English)

Diffusion models (DMs) have become dominant in visual generation but suffer performance drop when tested on resolutions that differ from the training scale, whether lower or higher. In fact, the key challenge in generating variable-scale images lies in the differing amounts of information across resolutions, which requires information conversion procedures to be varied for generating variable-scaled images. In this paper, we investigate the issues of three critical aspects in DMs for a unified analysis in variable-scaled generation: dilated convolution, attention mechanisms, and initial noise. Specifically, 1) dilated convolution in DMs for the higher-resolution generation loses high-frequency information. 2) Attention for variable-scaled image generation struggles to adjust the information aggregation adaptively. 3) The spatial distribution of information in the initial noise is misaligned with variable-scaled image. To solve the above problems, we propose \textbf{InfoScale}, an information-centric framework for variable-scaled image generation by effectively utilizing information from three aspects correspondingly. For information loss in 1), we introduce Progressive Frequency Compensation module to compensate for high-frequency information lost by dilated convolution in higher-resolution generation. For information aggregation inflexibility in 2), we introduce Adaptive Information Aggregation module to adaptively aggregate information in lower-resolution generation and achieve an effective balance between local and global information in higher-resolution generation. For information distribution misalignment in 3), we design Noise Adaptation module to re-distribute information in initial noise for variable-scaled generation. Our method is plug-and-play for DMs and extensive experiments demonstrate the effectiveness in variable-scaled image generation.

扩散模型多尺度生成信息利用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。