arXiv:2509.16986cs.CV2025-09被引 2

通过视觉对比学习,精准消除自回归图像生成中的不安全内容。

VCE: Safe Autoregressive Image Generation via Visual Contrast Exploitation

  • 构建图像对比对,分离不安全概念与语义
  • 基于DPO训练增强模型识别视觉差异能力
  • 支持风格、内容、物体三类安全擦除

自回归图像生成模型虽能生成高度逼真的图像,如模仿吉卜力、梵高等艺术风格,但也可能生成不当内容(NSFW),引发版权与伦理问题。现有概念擦除方法多针对扩散模型,难以适配逐标记生成的自回归模型。本文提出视觉对比剥脱(VCE)框架:首先设计创新的对比图像对构造策略,精确解耦不安全概念与其内容语义;其次采用基于直接偏好优化(DPO)的训练方法,强化模型对图像对间视觉对比特征的识别与利用能力,实现精准概念擦除。在艺术家风格擦除、显性内容删除和物体移除三个挑战任务中,VCE均达到当前最优效果,有效清除不安全内容,同时保留无关安全概念的完整性。代码与模型已开源。

原文摘要 · Abstract (English)

Recently, autoregressive image generation models have wowed audiences with their remarkable capability in creating surprisingly realistic images. Models such as GPT-4o and LlamaGen can not only produce images that faithfully mimic renowned artistic styles like Ghibli, Van Gogh, or Picasso, but also potentially generate Not-Safe-For-Work (NSFW) content, raising significant concerns regarding copyright infringement and ethical use. Despite these concerns, methods to safeguard autoregressive text-to-image models remain underexplored. Previous concept erasure methods, primarily designed for diffusion models that operate in denoising latent space, are not directly applicable to autoregressive models that generate images token by token. To address this critical gap, we propose Visual Contrast Exploitation (VCE), a novel framework comprising: (1) an innovative contrastive image pair construction paradigm that precisely decouples unsafe concepts from their associated content semantics, and (2) a sophisticated DPO-based training approach that enhances the model's ability to identify and leverage visual contrastive features from image pairs, enabling precise concept erasure. Our comprehensive experiments across three challenging tasks-artist style erasure, explicit content erasure, and object removal-demonstrate that our method effectively secures the model, achieving state-of-the-art results while erasing unsafe concepts and maintaining the integrity of unrelated safe concepts. The code and models are available at https://github.com/Maplebb/VCE.

图像生成安全生成对比学习自回归

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。