arXiv:2606.05071cs.CV2026-06

用双边空间快速高保真地按指令修图,效率远超现有方法。

InstantRetouch: Efficient and High-Fidelity Instruction-Guided Image Retouching with Bilateral Space

论文配图:InstantRetouch: Efficient and High-Fidelity Instruction-Guided Image Retouching with Bilateral Space
图 1 · 摘自论文原文
  • 通过低分辨率双边网格预测仿射变换,解耦内容与编辑操作。
  • 相比最新方法,延迟降低80%以上,无内容漂移且视觉效果更佳。
  • 适合需要快速精准修图的设计师和摄影工作者使用。

语言引导的图像修图旨在调整色彩与色调的同时保持几何结构和纹理。近期基于扩散模型的方法虽视觉质量优越,但因生成特性易出现保真度问题,且迭代采样过程效率低下。本文提出一种基于双边空间操作的高效高保真修图方法,兼具紧凑性与内容解耦性。具体而言,模型不直接编辑像素或图像隐向量,而是预测低分辨率双边网格中的仿射变换,再通过学习的引导图切片并应用于全分辨率图像。该方法实现高保真与效率双重提升。为保留预训练生成模型的强大先验,采用变分分数蒸馏将多步扩散模型压缩至双边网格框架,并引入提示对齐损失以增强指令遵循能力。此外,我们构建了一个新基准,从保真度、指令遵循与效率三方面评估方法。相比最新方法如Gemini-2.5-Flash(Nano-Banana),本方法避免内容漂移,显著降低延迟,生成视觉上更令人满意的编辑结果,同时保持高保真水平。

原文摘要 · Abstract (English)

Language-guided photo retouching aims to adjust color and tone while preserving geometry and texture. Recently, diffusion-based retouching shows a superior visual quality, but often struggles with both fidelity issues due to its generative nature and efficiency because of its iterative sampling process. In this work, we propose an efficient and fidelity-preserving retouching method using bilateral space manipulation, which is both compact and content-decoupled. Specifically, instead of directly editing pixels or image latents, our model predicts a low-resolution bilateral grid of affine transforms, which are sliced using a learned guidance map and then applied to the full-resolution image. This approach yields both high fidelity and improved efficiency. To retain strong priors of a pretrained generative model, we distill a multi-step diffusion model into our bilateral grid framework using Variational Score Distillation, complemented by a prompt alignment loss to guide instruction-following behavior. Additionally, we introduce a new benchmark and evaluate our method across multiple dimensions: fidelity, instruction following, and efficiency. Compared to the latest retouch methods, like Gemini-2.5-Flash (Nano-Banana), our method can avoid content drift, significantly improve latency, and generate visually pleasing edits, while maintaining a high level of fidelity. Project page: https://openimaginglab.github.io/InstantRetouch/.

图像修图双边空间高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。