arXiv:2605.02152cs.CV2026-05被引 1

无需训练的图像编辑加速方法,按语义需求动态调整分辨率。

SpecEdit: Training-Free Acceleration for Diffusion based Image Editing via Semantic Locking

论文配图:SpecEdit: Training-Free Acceleration for Diffusion based Image Editing via Semantic Locking
图 1 · 摘自论文原文
  • 先低分辨率草稿预测语义,再识别需精细处理的区域
  • 在Qwen-Image-Edit上实现最高10倍加速,质量保持良好
  • 适合追求高效图像编辑的开发者与研究者使用

基于扩散模型的图像编辑虽具备强语义可控性,但因在所有空间标记上进行迭代高分辨率去噪而计算成本高昂。动态分辨率采样通过早期步骤降低分辨率来减少开销,但现有方法依赖边缘检测或通道方差等低层启发式策略进行上采样,与编辑语义对齐较弱,易引发结构不一致。此外,空间区域常被无差别上采样,未验证是否真需语义修改,导致冗余高分辨率计算与误差累积。为此,我们提出SpecEdit,一种面向扩散图像编辑的免训练动态分辨率框架。SpecEdit采用草稿-验证机制:先以低分辨率草稿估计语义结果,再利用标记级差异识别需高分辨率去噪的编辑相关标记,其余标记保持粗粒度。在Qwen-Image-Edit和FLUX.1-Kontext-dev上的实验表明,可分别实现最高10倍和7倍加速,同时保持高质量。SpecEdit与步数蒸馏等加速技术兼容,组合后可达13倍提速。代码见补充材料,将发布于GitHub。

原文摘要 · Abstract (English)

Diffusion-based image editing offers strong semantic controllability, but remains computationally expensive due to iterative high-resolution denoising over all spatial tokens. Dynamic-resolution sampling reduces this cost by performing early steps at reduced resolution. However, existing approaches prioritize upsampling using low-level heuristics such as edge detection or channel variance, which are weakly aligned with editing semantics and may lead to structural inconsistency. Moreover, spatial regions are often upsampled without verifying whether semantic modification is actually required, resulting in redundant high-resolution computation and accumulated errors. Therefore, we propose SpecEdit, a training-free dynamic-resolution framework tailored for diffusion-based image editing. SpecEdit follows a draft-and-verify scheme: a low-resolution draft first estimates the semantic outcome, after which token-level discrepancies are used to identify edit-relevant tokens for high-resolution denoising, while the remaining tokens stay at a coarse resolution. Experiments on Qwen-Image-Edit and FLUX.1-Kontext-dev demonstrate up to 10x and 7x acceleration, while maintaining strong quality. SpecEdit is complementary to step distillation and other acceleration techniques, achieving up to 13x speedup when combined with existing methods. Our code is in supplementary material and will be released on GitHub.

扩散模型图像编辑加速推理动态分辨率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。