arXiv:2510.25590cs.CVcs.AI2025-10被引 4

让图像编辑只重算变化区域,速度提升2.5倍以上

RegionE: Adaptive Region-Aware Generation for Efficient Image Editing

  • 分区域处理:已编辑区用多步去噪,未编辑区一步预测
  • 加速2.57倍,生成质量与原模型基本一致
  • 适合追求高效图像编辑的开发者和设计师

近期指令式图像编辑(IIE)受到广泛关注。实践中,IIE通常仅修改图像的特定区域,其余部分基本保持不变。然而,这两类区域在生成难度和计算冗余上差异显著,现有IIE模型未区分此差异,对全图采用统一生成流程。为此,我们提出RegionE——一种无需额外训练的自适应、区域感知生成框架。该框架包含三部分:1)自适应区域划分:基于最终估计结果与参考图的差异,在去噪早期将图像划分为编辑区与未编辑区;2)区域感知生成:未编辑区域替换为单步预测,编辑区则通过局部迭代去噪,并引入区域指令键值缓存,兼顾效率与全局信息;3)自适应速度衰减缓存:利用编辑区内相邻时间步速度相似性,加速局部去噪。将RegionE应用于Step1X-Edit、FLUX.1 Kontext和Qwen-Image-Edit等先进IIE模型,分别实现2.57、2.41和2.06倍加速,GPT-4o评估确认语义与感知保真度良好保留。

原文摘要 · Abstract (English)

Recently, instruction-based image editing (IIE) has received widespread attention. In practice, IIE often modifies only specific regions of an image, while the remaining areas largely remain unchanged. Although these two types of regions differ significantly in generation difficulty and computational redundancy, existing IIE models do not account for this distinction, instead applying a uniform generation process across the entire image. This motivates us to propose RegionE, an adaptive, region-aware generation framework that accelerates IIE tasks without additional training. Specifically, the RegionE framework consists of three main components: 1) Adaptive Region Partition. We observed that the trajectory of unedited regions is straight, allowing for multi-step denoised predictions to be inferred in a single step. Therefore, in the early denoising stages, we partition the image into edited and unedited regions based on the difference between the final estimated result and the reference image. 2) Region-Aware Generation. After distinguishing the regions, we replace multi-step denoising with one-step prediction for unedited areas. For edited regions, the trajectory is curved, requiring local iterative denoising. To improve the efficiency and quality of local iterative generation, we propose the Region-Instruction KV Cache, which reduces computational cost while incorporating global information. 3) Adaptive Velocity Decay Cache. Observing that adjacent timesteps in edited regions exhibit strong velocity similarity, we further propose an adaptive velocity decay cache to accelerate the local denoising process. We applied RegionE to state-of-the-art IIE base models, including Step1X-Edit, FLUX.1 Kontext, and Qwen-Image-Edit. RegionE achieved acceleration factors of 2.57, 2.41, and 2.06. Evaluations by GPT-4o confirmed that semantic and perceptual fidelity were well preserved.

图像编辑扩散模型加速推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。