给自回归图像生成模型加数字水印,防止模型自我污染。
BitMark: Watermarking Bitwise Autoregressive Image Generative Models
- 在生成过程的比特级直接嵌入水印,不改视觉效果和速度。
- 水印能抵抗多种移除手段,且在二次训练时仍可传递。
- 适合关注生成内容溯源与模型安全的研究者使用。
当前顶尖的文本到图像模型以空前速度生成逼真图像。本文聚焦于在离散令牌空间中以比特级自回归方式运行、令牌数量近乎无限的模型。尽管生成能力强大,但其输出日益充斥网络,存在被爬取并用作训练数据的风险——甚至可能被同一模型反复使用。这会导致模型崩溃,即在自身生成内容上重复训练,使性能逐渐退化。一种有前景的缓解策略是数字水印:在生成图像中嵌入人眼无法察觉但可检测的信号,实现生成内容识别。本文提出BitMark,一种鲁棒的比特级水印框架。该方法在图像生成过程中直接对令牌流的比特位嵌入水印,微妙影响比特以保持视觉保真度与生成速度,同时对抗多种移除技术。此外,水印具有高放射性:当用水印图像训练另一生成模型时,新模型输出也携带水印,即使仅对扩散或图像自回归模型进行微调,水印痕迹仍可检测。整体上,该方法为防止图像生成模型的模型崩溃提供了原则性方案,实现生成内容的可靠溯源。代码已公开于https://github.com/sprintml/BitMark。
原文摘要 · Abstract (English)
State-of-the-art text-to-image models generate photorealistic images at an unprecedented speed. This work focuses on models that operate in a bitwise autoregressive manner over a discrete set of tokens that is practically infinite in size. However, their impressive generative power comes with a growing risk: as their outputs increasingly populate the Internet, they are likely to be scraped and reused as training data-potentially by the very same models. This phenomenon has been shown to lead to model collapse, where repeated training on generated content, especially from the models' own previous versions, causes a gradual degradation in performance. A promising mitigation strategy is watermarking, which embeds human-imperceptible yet detectable signals into generated images-enabling the identification of generated content. In this work, we introduce BitMark, a robust bitwise watermarking framework. Our method embeds a watermark directly at the bit level of the token stream during the image generation process. Our bitwise watermark subtly influences the bits to preserve visual fidelity and generation speed while remaining robust against a spectrum of removal techniques. Furthermore, it exhibits high radioactivity, i.e., when watermarked generated images are used to train another image generative model, this second model's outputs will also carry the watermark. The radioactive traces remain detectable even when only fine-tuning diffusion or image autoregressive models on images watermarked with our BitMark. Overall, our approach provides a principled step toward preventing model collapse in image generative models by enabling reliable detection of generated outputs. The code is available at https://github.com/sprintml/BitMark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。