用差分隐私思想检测文生图模型侵权内容,无需原始数据即可识别。
Copyright Infringement Detection in Text-to-Image Diffusion Models via Differential Privacy
- 基于差分隐私设计敏感度指标,量化单个训练样本对生成结果的影响。
- 通过双向微调模拟数据增删,结合正交提示分布计算置信度得分。
- 构建了跨类别基准数据集CIDD,适合评估生成模型版权检测能力。
大规模视觉模型如Stable Diffusion的广泛应用引发了严重的法律与伦理问题,这些模型可能在未经授权的情况下记忆并复现受版权保护的内容。现有检测方法普遍缺乏鲁棒性,且理论基础薄弱。为此,本文从差分隐私(DP)视角形式化定义版权侵权及其检测,提出条件敏感度指标,量化特定训练数据点的增删对扩散模型输出的影响。为实现该指标,我们提出D-Plus-Minus(DPM)后处理检测框架:通过双向微调(学习/去学习)模拟数据包含与排除过程,并利用统计方法在正交提示分布上计算置信度分数,以分离概念特异性影响与全局参数偏移。此外,为支持标准化评估,我们构建了版权侵权检测数据集(CIDD),覆盖多种类别。实验表明,DPM可在不访问原始训练数据或文本提示的前提下,可靠检测侵权内容,提供可解释、实用的生成式AI知识产权保护方案。
原文摘要 · Abstract (English)
The widespread deployment of large vision models such as Stable Diffusion raises significant legal and ethical concerns, as these models can memorize and reproduce copyrighted content without authorization. Existing detection approaches often lack robustness and fail to provide rigorous theoretical underpinnings. To address these gaps, we formalize the concept of copyright infringement and its detection from the perspective of Differential Privacy (DP), and introduce the conditional sensitivity metric, a concept analogous to sensitivity in DP, that quantifies the deviation in a diffusion model's output caused by the inclusion or exclusion of a specific training data point. To operationalize this metric, we propose D-Plus-Minus (DPM), a novel post-hoc detection framework that identifies copyright infringement in text-to-image diffusion models. Specifically, DPM simulates inclusion and exclusion processes by fine-tuning models in two opposing directions: learning or unlearning. Besides, to disentangle concept-specific influence from the global parameter shifts induced by fine-tuning, DPM computes confidence scores over orthogonal prompt distributions using statistical metrics. Moreover, to facilitate standardized benchmarking, we also construct the Copyright Infringement Detection Dataset (CIDD), a comprehensive resource for evaluating detection across diverse categories. Our results demonstrate that DPM reliably detects infringement content without requiring access to the original training dataset or text prompts, offering an interpretable and practical solution for safeguarding intellectual property in the era of generative AI.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。