用内部细节增强技术提升真实图像修复的清晰度与可控性
Restoring Real-World Images with an Internal Detail Enhancement Diffusion Model
- 基于预训练扩散模型,通过内嵌细节增强机制保留结构纹理
- 在真实退化图像上显著优于现有方法,支持文本引导的物体级着色
- 适合需要高保真修复与精细控制的图像编辑场景
真实世界退化图像(如老照片、低分辨率图像)因混合退化因素(划痕、褪色、噪声等)修复难度大。现有数据驱动方法在保真度和对象级着色控制方面存在局限。本文提出一种内部细节增强扩散模型,利用预训练Stable Diffusion作为生成先验,避免从头训练。核心是内部图像细节增强(IIDE)技术,在潜在空间中注入模拟退化的操作,引导去噪过程同时保留关键结构与纹理信息。实验表明,该方法在定性与感知定量评估中均显著超越现有最优模型。此外,支持文本引导修复,实现专业级物体级着色控制。
原文摘要 · Abstract (English)
Restoring real-world degraded images, such as old photographs or low-resolution images, presents a significant challenge due to the complex, mixed degradations they exhibit, such as scratches, color fading, and noise. Recent data-driven approaches have struggled with two main challenges: achieving high-fidelity restoration and providing object-level control over colorization. While diffusion models have shown promise in generating high-quality images with specific controls, they often fail to fully preserve image details during restoration. In this work, we propose an internal detail-preserving diffusion model for high-fidelity restoration of real-world degraded images. Our method utilizes a pre-trained Stable Diffusion model as a generative prior, eliminating the need to train a model from scratch. Central to our approach is the Internal Image Detail Enhancement (IIDE) technique, which directs the diffusion model to preserve essential structural and textural information while mitigating degradation effects. The process starts by mapping the input image into a latent space, where we inject the diffusion denoising process with degradation operations that simulate the effects of various degradation factors. Extensive experiments demonstrate that our method significantly outperforms state-of-the-art models in both qualitative assessments and perceptual quantitative evaluations. Additionally, our approach supports text-guided restoration, enabling object-level colorization control that mimics the expertise of professional photo editing.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。