无需加水印即可追踪图像模型训练数据来源,识别侵权风险。
Training Data Attribution: Was Your Model Secretly Trained On Data Created By Mine?
- 利用文本生成图像模型的固有记忆特性,通过生成数据追溯训练源。
- 在不修改源模型的前提下,对可疑模型识别准确率超80%。
- 适合模型版权保护者、平台方使用,尤其适用于已发布预训练模型。
文本到图像模型的兴起引发了对潜在数据侵权的广泛关注。攻击者可能利用商业模型生成的数据来训练自己的模型而未获授权。为应对这一风险,需判断可疑模型的训练数据是否源自特定源模型。现有方法需在源模型的训练或推理阶段添加额外水印,但对已发布的预训练模型不实用,且要求模型所有者具备安全知识。为此,本文提出一种无需注入的训练数据溯源方法,可无须修改源模型即判断可疑模型的训练数据是否来自该源。核心思想是:文本到图像模型会记忆训练数据,这种记忆通过源模型生成的数据传递至下游模型,导致两者在特定样本上表现出一致行为。因此,我们开发算法识别这些独特样本,将其作为内在水印用于验证。实验表明,该方法在不干扰原训练或生成流程的情况下,对训练数据来源的识别准确率超过80%。
原文摘要 · Abstract (English)
The emergence of text-to-image models has recently sparked significant interest, but the attendant is a looming shadow of potential infringement by violating the user terms. Specifically, an adversary may exploit data created by a commercial model to train their own without proper authorization. To address such risk, it is crucial to investigate the attribution of a suspicious model's training data by determining whether its training data originates, wholly or partially, from a specific source model. To trace the generated data, existing methods require applying extra watermarks during either the training or inference phases of the source model. However, these methods are impractical for pre-trained models that have been released, especially when model owners lack security expertise. To tackle this challenge, we propose an injection-free training data attribution method for text-to-image models. It can identify whether a suspicious model's training data stems from a source model, without additional modifications on the source model. The crux of our method lies in the inherent memorization characteristic of text-to-image models. Our core insight is that the memorization of the training dataset is passed down through the data generated by the source model to the model trained on that data, making the source model and the infringing model exhibit consistent behaviors on specific samples. Therefore, our approach involves developing algorithms to uncover these distinct samples and using them as inherent watermarks to verify if a suspicious model originates from the source model. Our experiments demonstrate that our method achieves an accuracy of over 80\% in identifying the source of a suspicious model's training data, without interfering the original training or generation process of the source model.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。