通过逆域适应实现主动授权,防止模型盗用并追踪侵权源头。
IDEA: An Inverse Domain Expert Adaptation Based Active DNN IP Protection Method

- 将授权机制建模为逆域适应问题,用混合专家模型区分合法用户。
- 非法用户无法访问功能模型,且侵权溯源成功率超90%。
- 适合需要防窃取与责任追溯的AI模型部署场景。
深度神经网络(DNN)模型的非法复制、分发和衍生会带来经济损失、声誉损害甚至隐私泄露。被动式知识产权保护方法如水印和指纹只能在侵权后证明所有权,往往难以阻止严重损失,且对强攻击者防御力弱。本文提出IDEA,一种基于逆域适应的主动式DNN IP保护方法,具备主动授权与来源可追溯性。IDEA将主动授权视为域适应的逆问题,采用混合专家(MoE)模型,包含一个真实专家和两个虚假专家。真实专家通过嵌入用户密钥重新优化源模型,确保仅持有有效密钥的用户可正确分类测试图像;虚假专家通过最小化与真实专家的互信息,在无密钥或错误密钥下输出随机预测。最终通过多层注意力与对比表示损失最大化,将MoE知识蒸馏为统一保护模型,防止专家特征泄露。实验在五个数据集和四种DNN模型上验证了IDEA在授权控制、侵权溯源成功率及抗多种攻击方面的有效性。
原文摘要 · Abstract (English)
Illegitimate reproduction, distribution and derivation of Deep Neural Network (DNN) models can inflict economic loss, reputation damage and even privacy infringement. Passive DNN intellectual property (IP) protection methods such as watermarking and fingerprinting attempt to prove the ownership upon IP violation, but they are often too late to stop catastrophic damage of IP abuse and too feeble against strong adversaries. In this paper, we propose IDEA, an Inverse Domain Expert Adaptation based proactive DNN IP protection method featuring active authorization and source traceability. IDEA generalizes active authorization as an inverse problem of domain adaptation. The multi-adaptive optimization is solved by a mixture-of-experts model with one real and two fake experts. The real expert re-optimizes the source model to correctly classify test images with a unique model user key steganographically embedded. The fake experts are trained to output random prediction on test images without or with incorrect user key embedded by minimizing their mutual information (MI) with the real expert. The MoE model is knowledge distilled into a unified protected model to avoid leaking the expert model features by maximizing their MI with additional multi-layer attention and contrastive representation loss optimization. IDEA not only prevents unauthorized users without the valid key to access the functional model, but also enable the model owner to validate the deployed model and trace the source of IP infringement. We extensively evaluate IDEA on five datasets and four DNN models to demonstrate its effectiveness in authorization control, culprit tracing success rate, and robustness against various attacks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。