用分块文本提示逐步提升图像分辨率,修复4K画面更清晰一致。
MagnifiQ: Patch-aware Text Guided Progressive Upscaling for High-Resolution Image Restoration

- 分阶段逐步放大图像,每步用局部文本引导修复
- 在4096x4096分辨率下比现有方法更清晰、纹理更连贯
- 适合需要高保真图像恢复的视觉应用
从退化输入中恢复高分辨率图像极具挑战,需兼顾全局结构一致性与精细局部细节,尤其在4K分辨率下,直接使用扩散模型进行恢复计算开销大且易产生重复或不一致纹理。本文提出MagnifiQ框架,通过渐进式多阶段上采样恢复图像,例如从1024x1024逐步恢复至4096x4096。该方法采用预训练文本到图像扩散模型(如SDXL),将其原始自注意力层替换为计算成本随图像尺寸线性增长的卷积操作,实现可扩展的高分辨率推理。进一步设计渐进式上采样策略,逐级优化中间输出,而非直接生成最终4K图像,从而提升全局一致性并减少高分辨率伪影。为增强局部细节并控制内容漂移,引入针对每个图像块的文本提示,在修复过程中提供空间局部语义指导。大量实验表明,MagnifiQ在合成与真实退化图像上均优于现有扩散模型修复方法,在感知质量与人类偏好上表现更优,生成更锐利纹理与更连贯的4K结果,并可通过其可扩展骨干网络和渐进设计实现实用的速度-质量权衡。
原文摘要 · Abstract (English)
High-resolution image restoration from degraded inputs is challenging because it must preserve global structural consistency while recovering fine-grained local details, especially at 4K resolution where direct diffusion-based restoration is computationally expensive and prone to repeated or inconsistent textures. In this work, we introduce MagnifiQ, an image restoration framework that progressively upscales and restores images across resolutions, e.g., from 1024x1024 to 4096x4096. Our approach leverages a pre-trained text-to-image diffusion model such as SDXL and adapts it for more scalable high-resolution inference by replacing its original self-attention layers with convolutional operations whose computational cost grows linearly with image resolution. We further propose a progressive upscaling strategy that iteratively restores images over multiple resolution stages, refining each intermediate output rather than directly hallucinating the final 4K image, thereby improving global coherence and reducing high-resolution artifacts. To enhance local details while controlling content drift, MagnifiQ uses patch-specific text prompts that provide spatially localized semantic guidance during restoration. Extensive experiments on synthetic and real-world degraded images show that MagnifiQ outperforms prior diffusion-based restoration methods in perceptual quality and human preference, producing sharper textures and more coherent 4K results while offering practical speed--quality trade-offs through its scalable backbone and progressive design.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。