arXiv:2608.09322cs.CV2026-08中稿 · ACMMM 2026

提出异步分步编辑法,让图像改写更精准且背景不变。

Diffusion Image Editing via Asynchronous Token Decoding

论文配图:Diffusion Image Editing via Asynchronous Token Decoding
图 1 · 摘自论文原文
  • 分步异步更新图像令牌,按需选择要改的区域
  • 在 PIE-Bench 上实现 27.44dB PSNR 与 0.055 LPIPS 的保真度
  • 无需额外掩码或微调,适合快速精准图像编辑

文本引导的扩散图像编辑旨在修改图像语义属性的同时保持其身份、布局和背景。然而,在采样过程中直接切换文本条件常导致全局漂移,因为去噪动态会传播变化至所有令牌,破坏未编辑区域。为此,我们提出异步令牌解码编辑(ATDEdit),一种推理时框架,将每一步采样视为对全局耦合令牌矩阵的并行更新,并支持基于令牌索引的条件切换与差异化更新策略。不同于对所有令牌同步应用目标条件更新,ATDEdit通过令牌级条件意外度估计可编辑位置,并仅对选定令牌集施加目标条件修正。在保留令牌位置提供源键/值记忆,并将选定保留令牌的潜在行投影回源值;这些操作促进背景保留,但不保证像素级不变性。该方法在不使用外部或用户提供的空间掩码、也不进行模型微调的情况下,实现局部编辑与背景保留的结合。在 PIE-Bench 上,ATDEdit 达到报告中最强的保真度指标,包括 27.44 dB PSNR 与 0.055 LPIPS,同时保持良好的语义对齐能力。

原文摘要 · Abstract (English)

Text-guided diffusion image editing aims to modify semantic attributes of an image while preserving its identity, layout, and background. However, naïvely switching the text condition during sampling often causes global drift, as denoising dynamics propagate changes across tokens and can disrupt unedited regions. To address this issue, we propose \textbf{A}synchronous \textbf{T}oken \textbf{D}ecoding \textbf{Edit} (ATDEdit), an inference-time framework that views each sampler step as a parallel update of a globally coupled token matrix and enables token-indexed condition switching with differentiated update policies. Instead of applying synchronous target-conditioned updates to all tokens, ATDEdit estimates editable locations using token-wise conditional surprisal and applies target-conditioned corrections to the selected token set. It supplies source key/value memory at keep-token positions and projects selected keep-token latent rows back to their source values; these operations promote background preservation but do not constitute a pixel-level invariance guarantee. This approach combines local editing and background preservation without external or user-provided spatial masks and without model fine-tuning. On PIE-Bench, ATDEdit achieves the strongest reported preservation metrics, including 27.44~dB PSNR and 0.055 LPIPS, while retaining competitive semantic alignment.

图像编辑扩散模型异步更新

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。