arXiv:2607.06136cs.CVcs.MM2026-07

无需微调即可实现8K超高清图像编辑,解决细节模糊问题。

Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing

论文配图:Tuning-Free Latent Diffusion Models for Ultrahigh-Resolution Image Editing
图 1 · 摘自论文原文
  • 采用多尺度渐进式编辑,分步融合高分辨率内容与原始区域。
  • 支持最高8K分辨率,单张RTX 3090显卡即可运行。
  • 适合需要高质量图像编辑的设计师、摄影师及科研人员。

基于扩散模型的生成方法在图像生成与编辑中表现优异,但受限于内存和高分辨率训练数据获取成本,现有方法通常仅支持低于1K线性分辨率的输入。而现代手机拍摄的照片分辨率可达8K,两者之间存在显著差距。简单放大低分辨率编辑结果常导致视觉放大但模糊、细节缺失。本文提出UltraDiffEdit,一种无需微调的图像编辑框架,可将现成的潜在扩散模型(LDM)扩展至超高清分辨率。该方法采用多尺度渐进编辑策略,以粗到精的方式迭代融合高分辨率编辑内容与未编辑区域;通过多块编码保留潜在空间中的编辑与未编辑细节;引入全局-局部一致性去噪技术,整合编辑与未编辑潜在特征,确保边界过渡平滑;还设计了基于块的混合采样方法,捕捉局部、中间与全局特征,增强去噪过程中的语义连贯性与细节表现。大量实验表明,UltraDiffEdit在编辑质量与灵活性上均具优势:仅需单张NVIDIA GeForce RTX 3090 GPU即可处理高达8K分辨率的图像。代码已开源:https://github.com/LonglongaaaGo/UltraDiffEdit。

原文摘要 · Abstract (English)

Recent diffusion-based generative models have shown impressive performance in image generation and editing. However, due to memory limitations and the high cost of collecting high-resolution training images, existing methods are typically restricted to inputs with linear resolutions below 1K. In contrast, photos captured by modern mobile devices often reach linear resolutions up to 8K, revealing a significant gap between current capabilities and real-world demands. Simply upscaling low-resolution edited results often results in visually enlarged but blurry images that lack fine details. This paper introduces UltraDiffEdit, a novel, tuning-free image editing framework that extends off-the-shelf latent diffusion models (LDMs) to ultrahigh resolutions. UltraDiffEdit employs a multi-scale progressive editing strategy, iteratively blending high-resolution edited content with unedited areas in a coarse-to-fine manner. We employ multi-patch encoding to preserve both edited and unedited visual details within the latent space. To mitigate editing artifacts, our global-local consistency denoising technique consistently integrates edited and unedited latent features, ensuring smooth transition at editing boundaries from the latent representation to the final image. We also introduce a patch-based hybrid sampling approach that captures local, intermediate, and global features, ensuring semantic coherence and enhancing fine detail during denoising. We conduct extensive experiments demonstrating UltraDiffEdit's superior editing quality and flexibility: it can handle image resolutions up to 8K using only a single NVIDIA GeForce RTX 3090 GPU. The source code is publicly available at https://github.com/LonglongaaaGo/UltraDiffEdit.

图像编辑扩散模型8K超清无微调

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。