针对自回归图像生成中概念擦除难题,提出推理时最小干预方法
ScaleErasure: Inference-Time Minimal Intervention for Precise Concept Erasure in Next-Scale Autoregressive Image Generation

- 通过双重前向传播定位不安全概念相关输出
- 在多尺度、多标记、多比特通道上精准引导逻辑值
- 在严重语义纠缠下仍保持生成能力,适合高安全性场景
概念擦除旨在防止生成模型输出不安全内容,同时保持其通用生成能力。近期出现的下一代自回归(AR)图像生成以预测下一尺度为特征,其中概念擦除尚未得到充分研究。在此范式中,早期尺度的语义信息高度压缩,导致不安全与无关语义严重纠缠。本文提出 ScaleErasure,一种推理时的最小干预概念擦除方法。该方法精准选择并引导最相关的预测逻辑值,实现有效擦除。具体而言,ScaleErasure 在不安全概念和对应安全概念条件下进行两次额外前向传播,利用其输出引导目标逻辑值远离不安全概念,趋向安全概念。为实现精确且最小干预,逻辑值的选择与引导在尺度、标记和比特通道三个维度上进行。实验表明,ScaleErasure 在下一代 AR 范式中优于适配基线,实现更精确的概念擦除,同时显著保留通用生成能力。代码已开源:https://github.com/coziiizz/ScaleErasure。
原文摘要 · Abstract (English)
Concept erasure aims to prevent image generative models from producing unsafe content while preserving their general generative capability. Meanwhile, next-scale autoregressive (AR) image generation has recently emerged as a new generative paradigm characterized by next-scale prediction, for which concept erasure remains largely unexplored. In this paradigm, semantic information is highly compressed at early scales, leading to severe entanglement between unsafe and unrelated semantics. In this paper, we propose ScaleErasure, an inference-time concept erasure method that performs minimal intervention. ScaleErasure precisely selects and guides predicted logits that are most relevant to the unsafe concept, thereby enabling effective erasure under severe semantic entanglement. Specifically, ScaleErasure performs two additional forward passes conditioned on the unsafe concept and the corresponding safe concept, and leverages their outputs to guide the target logits away from unsafe concepts toward safe concepts. To enable precise and minimal intervention, logits selection and guidance are conducted across three dimensions: scales, tokens, and bit channels. Experiments demonstrate that ScaleErasure outperforms adapted baselines in the next-scale AR paradigm, achieving more precise concept erasure while largely preserving general generative capability. The code is available at https://github.com/coziiizz/ScaleErasure.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。