arXiv:2412.09960cs.CVeess.IV2024-12被引 4

提出双解码器框架,让水印模型更抗真实世界非可导干扰。

END$^2$: Robust Dual-Decoder Watermarking Framework Against Non-Differentiable Distortions

  • 用两个相同解码器,一个处理带水印图,一个处理受干扰图
  • 仅通过教师解码器反向传播梯度,避开非可导干扰的训练难题
  • 通过特征对齐提升鲁棒性,适合作为现有水印系统的通用增强

基于深度神经网络的水印方法快速发展,其中「编码器-噪声层-解码器」(END)框架应用最广。为实现端到端训练,该框架中的噪声层必须可导。然而真实世界干扰通常不可导,导致训练困难。现有方法仅将干扰视为加性噪声,未能充分融合干扰影响。为此,本文提出新型双解码器架构(END²)。不同于传统结构,本方法采用两个结构相同的解码器:教师解码器处理纯水印图像,学生解码器处理受干扰图像。梯度仅通过教师解码器分支回传以优化编码器,从而规避不可导问题。为提升对任意干扰的鲁棒性,通过最大化两者中间特征向量在超球面的余弦相似度,强制特征对齐。大量实验表明,本方案在多种非可导干扰下均优于当前最优算法。即使不考虑可导性约束,其性能仍超越使用可导噪声层的基线方法。该方法有效且易于集成至所有END架构中,显著提升实用性与泛化能力。

原文摘要 · Abstract (English)

DNN-based watermarking methods have rapidly advanced, with the ``Encoder-Noise Layer-Decoder'' (END) framework being the most widely used. To ensure end-to-end training, the noise layer in the framework must be differentiable. However, real-world distortions are often non-differentiable, leading to challenges in end-to-end training. Existing solutions only treat the distortion perturbation as additive noise, which does not fully integrate the effect of distortion in training. To better incorporate non-differentiable distortions into training, we propose a novel dual-decoder architecture (END$^2$). Unlike conventional END architecture, our method employs two structurally identical decoders: the Teacher Decoder, processing pure watermarked images, and the Student Decoder, handling distortion-perturbed images. The gradient is backpropagated only through the Teacher Decoder branch to optimize the encoder thus bypassing the problem of non-differentiability. To ensure resistance to arbitrary distortions, we enforce alignment of the two decoders' feature representations by maximizing the cosine similarity between their intermediate vectors on a hypersphere. Extensive experiments demonstrate that our scheme outperforms state-of-the-art algorithms under various non-differentiable distortions. Moreover, even without the differentiability constraint, our method surpasses baselines with a differentiable noise layer. Our approach is effective and easily implementable across all END architectures, enhancing practicality and generalizability.

水印鲁棒性双解码器DNN

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。