用混合模型提升图像水印抗攻击能力,适配各类生成模型。
Enhancing Robustness in Post-Processing Watermarking: An Ensemble Attack Network Using CNNs and Transformers
- 结合卷积与注意力机制,在空间和频域构建多维攻击网络。
- 在WAVES基准上,使StegaStamp抗重生成攻击能力提升18.743%。
- 无需模型内部结构,可为单张图像定制唯一水印,适合实际部署。
近期深度水印研究多聚焦于生成过程中的嵌入方式,而事后水印则更具灵活性,可应用于任意生成模型(如GAN、扩散模型)的输出,无需访问模型内部结构,且支持为每张图像嵌入唯一水印。本文聚焦事后水印,通过在训练中引入集成攻击网络增强其鲁棒性。我们构建了基于CNN与Transformer在空间域和频域的多种攻击网络组合,探究其对水印模型鲁棒性的影响。结果表明,空间域使用CNN、频域使用Transformer的组合效果最佳。在WAVES基准上,以平均比特准确率为指标,所提方法显著提升了基线水印方法在各类压力测试下的表现。尤其在WAVES定义的重生成攻击下,StegaStamp的性能提升达18.743%。代码已开源:https://github.com/aiiu-lab/DeepRobustWatermark。
原文摘要 · Abstract (English)
Recent studies on deep watermarking have predominantly focused on in-processing watermarking, which integrates the watermarking process into image generation. However, post-processing watermarking, which embeds watermarks after image generation, offers more flexibility. It can be applied to outputs from any generative model (e.g. GANs, diffusion models) without needing access to the model's internal structure. It also allows users to embed unique watermarks into individual images. Therefore, this study focuses on post-processing watermarking and enhances its robustness by incorporating an ensemble attack network during training. We construct various versions of attack networks using CNN and Transformer in both spatial and frequency domains to investigate how each combination influences the robustness of the watermarking model. Our results demonstrate that combining a CNN-based attack network in the spatial domain with a Transformer-based attack network in the frequency domain yields the highest robustness in watermarking models. Extensive evaluation on the WAVES benchmark, using average bit accuracy as the metric, demonstrates that our ensemble attack network significantly enhances the robustness of baseline watermarking methods under various stress tests. In particular, for the Regeneration Attack defined in WAVES, our method improves StegaStamp by 18.743%. The code is released at:https://github.com/aiiu-lab/DeepRobustWatermark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。