通过可逆扰动让模型学不到数据,同时保护版权水印不被干扰。
Reversible Unlearnable Examples: Towards the Copyright Protection in Deep Learning Era

- 用最小化输入输出互信息的方法生成难学扰动。
- 在多个数据集上实现90%以上版权保护率且水印提取准确率超95%。
- 适合需要防止模型盗训和水印泄露的图像版权保护场景。
深度学习的进步依赖大规模数据集,数据版权保护日益重要。现有方法通过添加精心设计的扰动使样本难以被模型学习,但存在数据泄露风险。当前面临两大威胁:非法模型训练与恶意数据泄露。我们发现,简单结合已有可用性攻击与水印技术会因负面交互效应失效。为此,本文提出新型版权保护机制:为防止未经授权的模型训练,生成具有强泛化能力的不可学习扰动,通过最小化模型输入与输出间的互信息实现;为消除扰动对水印提取的干扰,设计双提取策略,使用两个不同水印提取器。在ImageNet、CIFAR10和Pets数据集上的大量实验表明,该方法能有效提供全面的图像版权保护。代码已开源。
原文摘要 · Abstract (English)
Significant advancements in deep learning have been made possible by the utilization of large datasets, underscoring the critical importance of copyright protection. Adding meticulously designed perturbations to examples, making them unlearnable has become a crucial approach for safeguarding data copyright. Existing methods for creating unlearnable examples overlook the risk of data leakage, which can threaten data ownership. Thus, copyright protection in deep learning faces two main threats: illegal model training and malicious data leakage. We investigate that these two threats cannot be solved by straightforwardly combining existing availability attacks and watermarking techniques as their negative interaction effects. Therefore, in this paper, we propose a novel copyright protection mechanism for the aforementioned security concerns. Considering that the prevention of unauthorized model training requires powerful generalizability of unlearnable perturbations, we generate perturbations to induce the model to learn uncorrelated features of input images. It works by minimizing the mutual information of the input and output of the model. On the other hand, to eliminate the side impact of unlearnable perturbations on the watermark extraction, we design a dual extraction strategy by using two distinct watermark extractors. Extensive experiments on the image datasets {ImageNet, CIFAR10, and Pets} show that our proposed method could provide comprehensive copyright protection to images. The code is available at {https://github.com/Yeah21/ReversibleUnlearnableExamples}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。