arXiv:2608.09057cs.CV2026-08

用源图中心视角实现高效图像编辑,1.57秒完成千级图像修改

Model the Edit, Not the Image: Visual Autoregressive Editing from a Source-Centric Perspective

论文配图:Model the Edit, Not the Image: Visual Autoregressive Editing from a Source-Centric Perspective
图 1 · 摘自论文原文
  • 以源图令牌为基准,通过对比目标条件下的预测差异生成编辑方向
  • 1K图像编辑仅需1.57秒,保持高保真度与文本对齐能力
  • 无需反演或额外干预,适合快速原型设计与实时交互

下一代视觉自回归模型(VARs)凭借高效的粗粒度到细粒度预测,已成为强大的生成范式。然而其在文本引导图像编辑方面的潜力尚未充分挖掘。现有无训练VAR编辑方法通常将编辑建模为受源图约束的目标条件重生成,依赖反演、测试时优化、注意力控制或用户提供的掩码。这种生成中心范式未能充分利用VAR提供的多尺度源表示,可能引入额外计算或人工干预。本文提出一种源中心视角的编辑方法——EditMod:在共享自回归上下文中比较源条件与目标条件的预测,将二者差异作为逐尺度的编辑方向,并将其作为残差更新应用于选定尺度的源令牌。实验表明,EditMod在保持强文本对齐的同时,实现了领先的源图保真度,且在单张A100 GPU上可于1.57秒内完成1K图像的端到端编辑,无需每图像预处理。

原文摘要 · Abstract (English)

Next-scale visual autoregressive models (VARs) have emerged as a powerful generative paradigm, producing high-quality images through efficient coarse-to-fine prediction. However, their potential for text-guided image editing remains largely underexplored. Existing training-free VAR editing approaches often formulate editing as target-conditioned regeneration guided or constrained by the source image, and may rely on inversion, test-time optimization, attention control, or user-provided masks. This generation-centric formulation does not fully exploit the multiscale source representations provided by VARs and may introduce additional computation or intervention. We instead take a source-centric perspective on VAR editing, in which the encoded source image tokens serve as the primary visual state and the editing process focuses on condition-induced changes. Based on this perspective, we propose \textbf{EditMod}, which compares source- and target-conditioned predictions under a shared autoregressive context, treats their difference as a scale-wise editing direction, and applies it as a residual update to source tokens at selected scales. Experiments show that EditMod achieves leading source-image fidelity while maintaining strong text alignment, and completes end-to-end editing of a 1K image in only 1.57 seconds on a single A100 GPU without per-image preparation.

图像编辑自回归模型源图中心高效生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。