用无害数据污染标记数据所有权,防伪且不降性能
Data Taggants: Dataset Ownership Verification via Harmless Targeted Data Poisoning
- 用分布外样本+随机标签作密钥,悄悄植入可验证特征
- 在ImageNet上验证,检测准确率高且不影响模型精度
- 仅需黑盒访问,比传统水印更隐蔽、抗防御更强
数据集所有权验证用于判断模型训练是否使用了特定数据集,对防止未经授权的数据使用和数据污染至关重要。现有方法如后门水印依赖于在模型中引入可检测行为,但存在损害模型性能或需访问模型内部的缺陷,且无法保证无误报。本文提出数据标签(Data Taggants),一种新型非后门式所有权验证技术。该方法使用分布外样本与随机标签作为密钥,通过干净标签的目标数据污染,在数据集中悄然修改,使训练出的模型对密钥样本响应为对应标签。密钥设计支持仅通过黑盒访问模型即可生成统计证明。我们在ImageNet1k上,使用ViT和ResNet模型,采用最先进的训练方案进行了全面实验。结果表明,数据标签可高置信度可靠检测出基于受保护数据集训练的模型,且不损害验证精度,并优于传统后门水印方法。我们还验证了该方法在多种防御机制下的隐蔽性与鲁棒性。
原文摘要 · Abstract (English)
Dataset ownership verification, the process of determining if a dataset is used in a model's training data, is necessary for detecting unauthorized data usage and data contamination. Existing approaches, such as backdoor watermarking, rely on inducing a detectable behavior into the trained model on a part of the data distribution. However, these approaches have limitations, as they can be harmful to the model's performances or require unpractical access to the model's internals. Most importantly, previous approaches lack guarantee against false positives. This paper introduces data taggants, a novel non-backdoor dataset ownership verification technique. Our method uses pairs of out-of-distribution samples and random labels as secret keys, and leverages clean-label targeted data poisoning to subtly alter a dataset, so that models trained on it respond to the key samples with the corresponding key labels. The keys are built as to allow for statistical certificates with black-box access only to the model. We validate our approach through comprehensive and realistic experiments on ImageNet1k using ViT and ResNet models with state-of-the-art training recipes. Our findings demonstrate that data taggants can reliably detect models trained on the protected dataset with high confidence, without compromising validation accuracy, and show their superiority over backdoor watermarking. We demonstrate the stealthiness and robustness of our method against various defense mechanisms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。