为AI嵌入服务设计强鲁棒且低侵入的水印机制
Robust and Minimally Invasive Watermarking for EaaS
- 为每个嵌入注入独特水印,避免共用成分
- 水印可抵抗激进移除攻击,嵌入质量损失<1%
- 适合需要版权保护的EaaS系统部署
嵌入即服务(EaaS)在人工智能应用中日益重要,但易受模型提取攻击,亟需版权保护。现有水印方法通过线性插值在含触发词的文本中注入目标嵌入,导致所有水印嵌入共享相同成分,易被识别和移除。为此,本文提出嵌入特定水印机制(ESpeW),为每个嵌入注入唯一且可快速识别的水印。这些水印彼此保持显著距离,不共享公共组件,极大提升移除难度。此外,ESpeW具有极低侵入性,对嵌入影响小于1%,达到EaaS水印新标杆。在四个主流数据集上的大量实验表明,即便面对高度激进的移除策略,ESpeW仍能有效保留水印且不损害嵌入质量。
原文摘要 · Abstract (English)
Embeddings as a Service (EaaS) is emerging as a crucial role in AI applications. Unfortunately, EaaS is vulnerable to model extraction attacks, highlighting the urgent need for copyright protection. Although some preliminary works propose applying embedding watermarks to protect EaaS, recent research reveals that these watermarks can be easily removed. Hence, it is crucial to inject robust watermarks resistant to watermark removal attacks. Existing watermarking methods typically inject a target embedding into embeddings through linear interpolation when the text contains triggers. However, this mechanism results in each watermarked embedding having the same component, which makes the watermark easy to identify and eliminate. Motivated by this, in this paper, we propose a novel embedding-specific watermarking (ESpeW) mechanism to offer robust copyright protection for EaaS. Our approach involves injecting unique, yet readily identifiable watermarks into each embedding. Watermarks inserted by ESpeW are designed to maintain a significant distance from one another and to avoid sharing common components, thus making it significantly more challenging to remove the watermarks. Moreover, ESpeW is minimally invasive, as it reduces the impact on embeddings to less than 1\%, setting a new milestone in watermarking for EaaS. Extensive experiments on four popular datasets demonstrate that ESpeW can even watermark successfully against a highly aggressive removal strategy without sacrificing the quality of embeddings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。