arXiv:2606.15188cs.CV2026-06

通过早期潜空间验证,智能筛选初始噪声,提升图像编辑质量与效率。

Adaptive Inference-Time Scaling via Early-Step Latent Verification for Image Editing

论文配图:Adaptive Inference-Time Scaling via Early-Step Latent Verification for Image Editing
图 1 · 摘自论文原文
  • 在早期潜空间用激活图评估初始噪声是否可有效编辑目标区域
  • 相比传统方法减少40%以上函数调用次数,且编辑效果更稳定
  • 适合需要高精度图像编辑的复杂场景,如设计、内容生成

基于指令的图像编辑虽有显著进展,但结果质量仍受随机初始噪声影响,尤其在复杂编辑任务中。不合适的初始噪声可能导致较差编辑效果。现有推理时缩放方法通过采样多个初始噪声并筛选更优候选来缓解该问题,但多数采用解码后验证方案,带来效率与精度的权衡:早期解码图像过噪难以可靠评估,充分去噪又需高昂计算成本。为此,我们提出VeriLatent——一种即插即用的自适应推理时缩放框架,通过早期潜空间验证实现高效筛选。具体地,设计一个新型验证器,在早期阶段利用潜空间编辑激活图对每个初始噪声打分,判断其是否能在正确区域引发有效编辑,从而无需解码即可实现高效候选过滤。在此基础上,进一步构建自适应搜索策略,根据编辑难度动态分配推理预算,显著降低函数调用次数(NFE)。在多个基准数据集和不同基础模型上的实验表明,VeriLatent持续提升编辑性能与推理效率。

原文摘要 · Abstract (English)

Instruction-based image editing has made notable progress with recent advances in generative models. However, the quality of the edited result is still influenced by the randomly sampled initial noise, particularly in complex editing scenarios. An unsuitable initial noise may lead to unsatisfactory editing results. Recent inference-time scaling methods address this issue by sampling multiple initial noises and selecting better candidates. Nevertheless, most of them follow a decode-then-verify scheme which introduces an efficiency-accuracy trade-off. When decoding is performed after limited inference steps, the decoded images often remain too noisy for reliable assessment, whereas sufficiently denoised images require much higher computational cost. To address this issue, we propose VeriLatent, a plug-and-play adaptive inference-time scaling framework with early-step latent verification for image editing. Specifically, we propose a novel verifier that scores each initial noise through a latent-space editing activation map at an early stage. It identifies promising candidates by assessing whether they can induce an effective edit in the correct region. This enables efficient early pruning without decoding latents into images. Building on this, we further develop an adaptive search strategy for inference-time scaling. It allocates inference budgets according to editing difficulty, thereby reducing the number of function evaluations (NFE). Extensive experiments on multiple benchmarks and different base models demonstrate that VeriLatent consistently improves both editing performance and inference-time scaling efficiency.

图像编辑推理优化潜空间

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。