arXiv:2606.13558cs.CVcs.CL2026-06

通过位级残差编辑,实现精准图像修改且不破坏背景。

Edit the Bits, Diff the Codes: Bitwise Residual Editing for Visual Autoregressive Models

论文配图:Edit the Bits, Diff the Codes: Bitwise Residual Editing for Visual Autoregressive Models
图 1 · 摘自论文原文
  • 直接操作比特预测和多尺度残差码,利用代码加法特性精确控制修改区域。
  • 在PIE-Bench上使编辑区域的CLIP分数提升1.07,背景保留效果优于以往方法。
  • 无需训练,适合希望快速微调视觉自回归模型的开发者使用。

基于文本引导的图像编辑在视觉自回归(VAR)生成器中需同时控制采样内容与写回位置。现有编辑方法主要作用于令牌流、特征或平坦的下一次令牌概率,忽略了比特残差型VAR模型的两个原生结构:逐比特伯努利预测头与图像由其构建的加性多尺度残差码场。本文提出BitResEdit,一种针对如Infinity等比特残差型VAR生成器的免训练编辑方法。BitEdit通过在共享编辑前缀上计算源-目标对比,倾斜后置CFG的逐比特对数几率,再将更新投影至围绕干净CFG采样器的闭式伯努利-KL信任区域;ResEdit将采样比特转换为各尺度连续码残差,用定位掩码门控后,通过生成器原有的多尺度求和机制重新注入。二者结合决策时比特引导与组合时代码合成,使被遮蔽的潜在特征通过代码算术精确保留,而局部化、尺度感知的修改仅作用于目标区域。在PIE-Bench与Infinity-2B上的实验表明,BitResEdit在同主干模型的VAR编辑器中达到最强文本对齐效果,编辑区域的CLIP分数相较最强先前编辑器提升+1.07,同时保持背景保留竞争力。消融实验证明BitEdit与ResEdit在目标对齐与背景保留中发挥互补作用。

原文摘要 · Abstract (English)

Text-guided image editing with visual autoregressive (VAR) generators requires controlling both what the model samples and where the sampled change is written back into the image code. Existing VAR editors mainly operate on token streams, features, or flat next-token logits, leaving two native structures of bitwise-residual VAR models underused: the per-bit Bernoulli prediction head and the additive multi-scale residual code field from which the image is assembled. We propose BitResEdit, a training-free editor for bitwise-residual VAR generators such as Infinity. BitEdit performs source-negative guidance by tilting the post-CFG per-bit log-odds along a source--target contrast computed on a shared edited prefix, then projects each update into a closed-form Bernoulli-KL trust region around the clean CFG sampler. ResEdit converts the sampled bits into per-scale continuous-code residuals, gates them with a localization mask, and re-injects them through the generator's native sum-of-scales. Together they couple decision-time bit guidance with combination-time code composition, so masked-out latent features are preserved exactly by code arithmetic while localized, scale-aware edits are applied inside the target region. On PIE-Bench with Infinity-2B, BitResEdit attains the strongest text alignment among same-backbone VAR editors, improving CLIP on the edited region by +1.07 over the strongest prior editor while keeping background preservation competitive with it. Ablations show BitEdit and ResEdit play complementary roles in target alignment and background preservation.

图像编辑自回归模型比特级控制免训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。