通过控制生成质量实现扩散模型的主动版权保护,防止未授权使用。
PCDiff: Proactive Control for Ownership Protection in Diffusion Models with Watermark Compatibility
- 在解码器中嵌入可训练融合模块与分级认证层,验证凭据后才生成高质量图像。
- 无有效密钥时输出质量显著下降,多种攻击下仍保持权限与质量强关联。
- 兼容现有水印技术,适合需主动控权又保留溯源能力的模型所有者。
随着文本到图像扩散模型知识产权保护需求的增长,我们提出PCDiff——一种主动访问控制框架,通过调节生成质量重新定义模型授权。其核心在于将可训练融合模块与分层认证机制集成至解码器架构中,确保仅持有有效加密凭证的用户可生成高保真图像;在缺乏有效密钥时,系统会刻意降低输出质量,有效防止未经授权的使用。重要的是,尽管主要机制通过架构干预实现主动访问控制,但其解耦设计仍兼容现有水印技术,满足模型所有者主动控制所有权的同时,保留传统水印带来的可追溯性。大量实验评估表明,在多种攻击场景下,凭证验证与图像质量间存在强烈依赖关系。此外,与典型后处理操作结合时,PCDiff在性能上优于传统水印方法。该工作实现了从被动检测到主动执行授权的范式转变,为扩散模型的知识产权管理奠定了基础。
原文摘要 · Abstract (English)
With the growing demand for protecting the intellectual property (IP) of text-to-image diffusion models, we propose PCDiff -- a proactive access control framework that redefines model authorization by regulating generation quality. At its core, PCDIFF integrates a trainable fuser module and hierarchical authentication layers into the decoder architecture, ensuring that only users with valid encrypted credentials can generate high-fidelity images. In the absence of valid keys, the system deliberately degrades output quality, effectively preventing unauthorized exploitation.Importantly, while the primary mechanism enforces active access control through architectural intervention, its decoupled design retains compatibility with existing watermarking techniques. This satisfies the need of model owners to actively control model ownership while preserving the traceability capabilities provided by traditional watermarking approaches.Extensive experimental evaluations confirm a strong dependency between credential verification and image quality across various attack scenarios. Moreover, when combined with typical post-processing operations, PCDIFF demonstrates powerful performance alongside conventional watermarking methods. This work shifts the paradigm from passive detection to proactive enforcement of authorization, laying the groundwork for IP management of diffusion models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。