用视频扩散模型生成32K超长图像,解决传统方法的结构崩溃问题。
ScrollScape: Unlocking 32K Image Generation With Video Diffusion Priors
- 将超长图像生成转为连续视频过程,利用时间一致性保证全局结构。
- 支持32K分辨率输出,消除对象重复和空间碎片化等严重伪影。
- 适合需要极高分辨率长图的应用,如艺术创作、地图生成。
尽管扩散模型在常规尺寸图像生成上表现优异,但在生成极端长宽比(EAR)的超高清图像时,常出现物体重复和空间碎片化等灾难性结构失败。这本质上源于缺乏稳健的空间先验,因静态文本到图像模型主要训练于常规尺寸图像分布。为此,我们提出ScrollScape,通过两项核心创新将EAR图像合成重构为连续视频生成过程。通过将巨大画布的空间扩展映射为视频帧的时间演化,ScrollScape利用视频模型固有的时间一致性作为强全局约束,确保长程结构完整性。具体地,扫描位置编码(ScanPE)将全局坐标分布至各帧,充当灵活移动相机;滚动超分辨率(ScrollSR)借助视频超分辨率先验,克服内存瓶颈,高效实现32K分辨率输出。在自建的3K多比例图像数据集上微调后,ScrollScape有效对齐预训练视频先验与EAR生成任务。大量实验表明,其显著优于现有图像扩散基线,彻底消除严重局部伪影。因此,该方法突破了固有的结构瓶颈,在极端尺度下实现跨领域的卓越全局连贯性与视觉保真度。
原文摘要 · Abstract (English)
While diffusion models excel at generating images with conventional dimensions, pushing them to synthesize ultra-high-resolution imagery at extreme aspect ratios (EAR) often triggers catastrophic structural failures, such as object repetition and spatial fragmentation. This limitation fundamentally stems from a lack of robust spatial priors, as static text-to-image models are primarily trained on image distributions with conventional dimensions. To overcome this bottleneck, we present ScrollScape, a novel framework that reformulates EAR image synthesis into a continuous video generation process through two core innovations. By mapping the spatial expansion of a massive canvas to the temporal evolution of video frames, ScrollScape leverages the inherent temporal consistency of video models as a powerful global constraint to ensure long-range structural integrity. Specifically, Scanning Positional Encoding (ScanPE) distributes global coordinates across frames to act as a flexible moving camera, while Scrolling Super-Resolution (ScrollSR) leverages video super-resolution priors to circumvent memory bottlenecks, efficiently scaling outputs to an unprecedented 32K resolution. Fine-tuned on a curated 3K multi-ratio image dataset, ScrollScape effectively aligns pre-trained video priors with the EAR generation task. Extensive evaluations demonstrate that it significantly outperforms existing image-diffusion baselines by eliminating severe localized artifacts. Consequently, our method overcomes inherent structural bottlenecks to ensure exceptional global coherence and visual fidelity across diverse domains at extreme scales.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。