通过梯度锐化提升模型水印的鲁棒性与安全性
WaterMAS: Sharpness-Aware Maximization for Neural Network Watermarking
- 在训练中通过梯度空间锐化嵌入水印,保持权重不变
- 支持更高数据载荷,对噪声、剪枝等攻击保持鲁棒
- 密钥为随机选取的权重位置,适合保护模型知识产权
当前深度神经网络广泛应用于多个关键场景,其完整性与知识产权保护至关重要。为此,我们提出WaterMAS,一种替代式、白盒神经网络水印方法,显著改善了鲁棒性、不可感知性和计算复杂度之间的权衡,并支持更高的数据载荷与安全性。WaterMAS在保持水印权重不变的前提下,通过锐化其底层梯度空间来增强鲁棒性:即使权重发生微小变动,也会显著影响模型性能。不可感知性通过训练过程中的水印嵌入实现。水印数据载荷、不可感知性与鲁棒性之间的关系被系统分析。密钥由模型多层中随机选择的水印权重位置构成。安全性通过分析攻击者截获密钥的情形进行评估。实验覆盖5个模型和2项任务(CIFAR10图像分类使用VGG16、ResNet18、MobileNetV3、SwinT,Cityscapes图像分割使用DeepLabV3),并测试4类攻击(高斯噪声添加、剪枝、微调、量化)。代码将在论文接受后开源。
原文摘要 · Abstract (English)
Nowadays, deep neural networks are used for solving complex tasks in several critical applications and protecting both their integrity and intellectual property rights (IPR) has become of utmost importance. To this end, we advance WaterMAS, a substitutive, white-box neural network watermarking method that improves the trade-off among robustness, imperceptibility, and computational complexity, while making provisions for increased data payload and security. WasterMAS insertion keeps unchanged the watermarked weights while sharpening their underlying gradient space. The robustness is thus ensured by limiting the attack's strength: even small alterations of the watermarked weights would impact the model's performance. The imperceptibility is ensured by inserting the watermark during the training process. The relationship among the WaterMAS data payload, imperceptibility, and robustness properties is discussed. The secret key is represented by the positions of the weights conveying the watermark, randomly chosen through multiple layers of the model. The security is evaluated by investigating the case in which an attacker would intercept the key. The experimental validations consider 5 models and 2 tasks (VGG16, ResNet18, MobileNetV3, SwinT for CIFAR10 image classification, and DeepLabV3 for Cityscapes image segmentation) as well as 4 types of attacks (Gaussian noise addition, pruning, fine-tuning, and quantization). The code will be released open-source upon acceptance of the article.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。