为生成图像设计可抵御攻击的水印系统,支持快速更新与高鲁棒性。
MOLM: Mixture of LoRA Markers
- 用轻量LoRA适配器按密钥路由嵌入水印,避免重训练
- 在Stable Diffusion和FLUX上实现95%以上水印恢复率
- 适合需要溯源与防篡改的AI生成内容场景
生成模型可大规模生成逼真图像,引发对合成图像检测与来源追溯的担忧。水印技术被视为潜在解决方案,但现有方法易受真实扭曲影响、易被自适应移除,且密钥变更时更新成本高。本文提出一种通用水印框架,将编码问题建模为生成模型参数的关键依赖扰动。在此框架下,引入基于路由的Mixture of LoRA Markers(MOLM),通过二进制密钥激活残差块和注意力块中的轻量LoRA适配器。该设计无需密钥特定重训练,实现不可察觉性、保真度、可验证性与鲁棒性。在Stable Diffusion和FLUX上的实验表明,MOLM在保持图像质量的同时,对失真、压缩、再生、平均攻击及黑盒对抗攻击下的提取器具有强鲁棒性,平均水印恢复率超过95%。
原文摘要 · Abstract (English)
Generative models can generate photorealistic images at scale. This raises urgent concerns about the ability to detect synthetically generated images and attribute these images to specific sources. While watermarking has emerged as a possible solution, existing methods remain fragile to realistic distortions, susceptible to adaptive removal, and expensive to update when the underlying watermarking key changes. We propose a general watermarking framework that formulates the encoding problem as key-dependent perturbation of the parameters of a generative model. Within this framework, we introduce Mixture of LoRA Markers (MOLM), a routing-based instantiation in which binary keys activate lightweight LoRA adapters inside residual and attention blocks. This design avoids key-specific re-training and achieves the desired properties such as imperceptibility, fidelity, verifiability, and robustness. Experiments on Stable Diffusion and FLUX show that MOLM preserves image quality while achieving robust key recovery against distortions, compression and regeneration, averaging attacks, and black-box adversarial attacks on the extractor.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。