为联邦学习设计可追踪的黑盒水印,防止模型泄露。
Traceable Black-box Watermarks for Federated Learning
- 将模型参数分为任务区和水印区,仅聚合任务区参数。
- 各客户端独立学习专属水印,保持主任务性能不变。
- 可在黑盒环境下验证模型来源,适合版权保护场景。
由于联邦学习(FL)系统的分布式特性,每个本地客户端均可访问全局模型,存在严重的模型泄露风险。现有方法虽尝试在本地模型中注入水印以实现知识产权保护,但或仅支持不可追踪水印,或仅支持需白盒信息的可追踪水印。本文首次正式定义了可追踪黑盒水印问题,并提出新型服务器端水印方法 $ extbf{TraMark}$,为每个客户端生成可追溯的水印模型,支持在黑盒环境下验证模型泄露。$ extbf{TraMark}$ 将模型参数空间划分为主任务区域与水印区域,通过仅聚合主任务区域参数构建个性化全局模型,同时保留水印区域。各客户端在水印区域中使用独立水印数据集学习唯一水印后,再返回本地。大量实验表明,$ extbf{TraMark}$ 在多种联邦学习系统中均能保证所有水印模型的可追溯性,且不影响主任务性能。代码已公开于 https://github.com/JiiahaoXU/TraMark。
原文摘要 · Abstract (English)
Due to the distributed nature of Federated Learning (FL) systems, each local client has access to the global model, which poses a critical risk of model leakage. Existing works have explored injecting watermarks into local models to enable intellectual property protection. However, these methods either focus on non-traceable watermarks or traceable but white-box watermarks. We identify a gap in the literature regarding the formal definition of traceable black-box watermarking and the formulation of the problem of injecting such watermarks into FL systems. In this work, we first formalize the problem of injecting traceable black-box watermarks into FL. Based on the problem, we propose a novel server-side watermarking method, $\mathbf{TraMark}$, which creates a traceable watermarked model for each client, enabling verification of model leakage in black-box settings. To achieve this, $\mathbf{TraMark}$ partitions the model parameter space into two distinct regions: the main task region and the watermarking region. Subsequently, a personalized global model is constructed for each client by aggregating only the main task region while preserving the watermarking region. Each model then learns a unique watermark exclusively within the watermarking region using a distinct watermark dataset before being sent back to the local client. Extensive results across various FL systems demonstrate that $\mathbf{TraMark}$ ensures the traceability of all watermarked models while preserving their main task performance. The code is available at https://github.com/JiiahaoXU/TraMark.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。