arXiv:2606.25548cs.CVcs.LG2026-06中稿 · ICML

通过替换模型内部层实现精准去除非理想图像概念。

Concept Removal for Frontier Image Generative Models

论文配图:Concept Removal for Frontier Image Generative Models
图 1 · 摘自论文原文
  • 用可训练的转换器替代模型瓶颈层,分离特征以实现概念过滤。
  • 在SD3.5、Flux等模型上实现顶尖去概念效果,保持生成质量。
  • 支持连续移除多个概念,适合需可控生成的部署场景。

图像生成模型在大规模、未经筛选的互联网数据集上训练,包含不希望出现的视觉概念。如何在不降低输出图像质量的前提下高效移除这些概念仍具挑战。本文提出一种针对前沿扩散模型和图像自回归模型(如SD3.5、Flux、Infinity)的新概念移除方法。该方法将所有现代模型中的内部瓶颈层替换为一个可训练的转换器,使其在复制原层功能的同时,将激活特征结构化为独立单元。这种原位替换构建了一个集成过滤器,可选择性禁用特定概念信号,同时保留模型其余行为。由于干预作用于模型主干而非附加外部组件,因此在白盒访问下依然持久有效。实证表明,该方法在现代扩散与自回归模型中均达到领先的概念移除性能,维持生成质量,对对抗性提示具有鲁棒性,并支持多种概念的顺序移除,是前沿图像生成模型中概念移除的实用方案。

原文摘要 · Abstract (English)

Image generative models are trained on massive, largely uncurated internet-scale datasets that contain undesirable visual concepts. Efficiently removing such concepts from the model generations without degrading the quality of output images remains challenging. We introduce a novel concept removal method for frontier diffusion and image autoregressive models, such as SD3.5, Flux, and Infinity. Our intervention replaces the internal bottleneck layer present in all these modern models with a transcoder that is trained to replicate the original layer while structuring it into distinct activation features. This in-place substitution creates an integrated filter through which concept-specific signals can be selectively disabled while preserving the rest of the model's behavior. Since the intervention modifies the model backbone rather than attaching an external component, it remains persistent under white-box access. Empirically, the approach achieves state-of-the-art concept removal performance across modern diffusion and autoregressive models, maintains visual generation quality, provides robustness against adversarial prompts, and supports sequential removal of diverse concepts. This positions our method as a practical approach for concept removal in frontier image generative models.

图像生成概念移除扩散模型模型控制

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。