通过自迭代优化代码本,提升自回归图像生成的安全性。
Safe Autoregressive Image Generation with Iterative Self-Improving Codebooks

- 利用模型自身判断生成图像是否安全,无需人工标注。
- 迭代更新代码本,消除有害映射,同时保持图像质量。
- 适合关注图像生成安全性的研究者和开发者。
与在连续潜空间中运行的扩散模型不同,自回归统一多模态模型通过顺序预测离散视觉标记生成图像。这些标记源自将嵌入映射到量化视觉模式的代码本。其类语言架构使模型能有效捕捉文本条件信息,适用于文生图任务。这引发一个关键问题:此类自回归生成的图像有多安全?本文提出迭代自提升代码本方法以实现安全自回归图像生成。我们利用统一多模态模型自身的理解与判断能力,无需人工标注即可识别不安全生成图像。随后,固定代码本中的内在表示,消除有害映射。方法包含两步:首先,使用统一模型识别不安全生成,构建有害与安全图像-文本对,用于构建有害空间并指导代码本更新,从而消除有害输出;其次,在无害空间内使用安全图像-文本对对代码本进行自适应微调,确保生成图像质量。两步重复进行,直至无法进一步改进,最终得到安全性增强的模型代码本。无需额外外部反馈,模型安全性可逐步提升。
原文摘要 · Abstract (English)
Unlike diffusion-based models that operate in continuous latent spaces, autoregressive unified multimodal models produce images by sequentially predicting discretized visual tokens. These tokens are derived from a codebook that maps embeddings to quantized visual patterns. The language-like architecture enables unified multimodal models to effectively capture text conditional information for generation, making them promising for text-to-image tasks. This also raises an interesting question: how safe are the images generated in such an autoregressive way? In this work, we propose iterative self-improving codebooks for safe autoregressive generation. We leverage the understanding and judgment capabilities of the unified multimodal model itself to identify unsafe generated images without human annotation. Subsequently, the inherent representations in the codebook are fixed to eliminate harmful mappings. Our method comprises two steps: first, we use the unified model to identify unsafe generations and construct corresponding harmful and safe image-text pairs. These pairs are used to construct the Harmful Space and guide updates to the codebook, thereby eliminating harmful outputs. Second, we perform adaptive fine-tuning on the codebook within the harmless space using safe image-text pairs to ensure the quality of generated images. These two steps are repeated until no further improvement is observed, producing a safety-enhanced model codebook. Without additional external feedback, the safety of models is improved iteratively.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。