iSeal通过加密指纹实现可靠模型版权验证,防篡改能力强。
iSeal: Encrypted Fingerprinting for Reliable LLM Ownership Verification
- 将指纹嵌入模型与外部模块,结合纠错机制和相似性验证
- 在12个大模型上对10种攻击实现100%指纹成功率
- 适合需要高安全性的模型版权保护场景
由于从零训练大语言模型(LLM)成本高昂,保护其知识产权(IP)变得日益重要。当前主流的LLM指纹验证方法通过提取或注入模型特有特征来确认所有权,但忽略了验证过程中的潜在攻击,当模型盗用者完全控制推理过程时,这些方法失效。攻击者可共享提示-响应对以实现指纹遗忘,或操纵输出规避精确匹配验证。我们提出iSeal,首个面向端到端受控环境下的可靠指纹验证方法。它将独特特征同时注入模型与外部模块,并引入纠错机制和基于相似性的验证策略,有效抵御共谋式指纹遗忘和响应操纵等验证期攻击。理论分析与实证结果表明,iSeal在12个LLM上对超过10种攻击均实现100%指纹成功率(FSR),而基线方法在指纹遗忘和响应操纵下全部失败。
原文摘要 · Abstract (English)
Given the high cost of large language model (LLM) training from scratch, safeguarding LLM intellectual property (IP) has become increasingly crucial. As the standard paradigm for IP ownership verification, LLM fingerprinting thus plays a vital role in addressing this challenge. Existing LLM fingerprinting methods verify ownership by extracting or injecting model-specific features. However, they overlook potential attacks during the verification process, leaving them ineffective when the model thief fully controls the LLM's inference process. In such settings, attackers may share prompt-response pairs to enable fingerprint unlearning or manipulate outputs to evade exact-match verification. We propose iSeal, the first fingerprinting method designed for reliable verification when the model thief controls the suspected LLM in an end-to-end manner. It injects unique features into both the model and an external module, reinforced by an error-correction mechanism and a similarity-based verification strategy. These components are resistant to verification-time attacks, including collusion-based fingerprint unlearning and response manipulation, backed by both theoretical analysis and empirical results. iSeal achieves 100 percent Fingerprint Success Rate (FSR) on 12 LLMs against more than 10 attacks, while baselines fail under unlearning and response manipulations.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。