用反事实提示验证大模型所有权,抗干扰能力强。
Targeted Counterfactual Fingerprinting for Black-Box LLM Ownership Verification

- 设计受限答案的反事实提示,提升验证稳定性。
- 跨四类模型平均AUC达0.9861,优于现有方法0.07~0.19。
- 适合需在黑盒接口下确认模型归属的开发者使用。
大型语言模型(LLM)是高价值资产,可能通过重部署、微调、量化或进一步对齐被复制。由于部署后的模型通常仅通过查询接口暴露,所有权验证常依赖黑盒文本响应。这一场景困难:生成内容开放且重复查询结果可能变化,现有黑盒指纹依赖易受最终响应界面破坏的信号,如全文匹配、软行为特征或非可迁移的模型专属提示。我们提出TCF(目标反事实指纹),一种黑盒LLM指纹框架,将开放生成对比转化为受控回答的目标反事实转移。TCF将每个验证查询限制在有限答案空间内,减少进入验证分数的表面形式歧义,并优化提示扰动以达到与原始提示下受保护模型干净回答不同的反事实目标。验证简化为检查可疑模型的解析最终答案是否匹配记录目标。我们引入源模型反事实裕度(SCM),一种仅由受保护模型决定的量,用于证明目标在扰动前极不可能、扰动后很可能;SCM控制目标选择、扰动停止和指纹过滤。在由局部行为相近性驱动的衍生保留与独立迁移预算下,我们推导出衍生模型与独立模型间的目标准确率差距。在四个LLM家族中,TCF平均AUC达0.9861,相比TRAP、ProFLingo和ZeroPrint提升0.07至0.19。
原文摘要 · Abstract (English)
Large language models (LLMs) are high-value assets that can be derived through redeployment, fine-tuning, quantization, or further alignment. Because deployed LLMs are commonly exposed only through query APIs, ownership verification must often rely on black-box text responses. This setting is difficult: generations are open-ended and can vary across repeated queries, while existing black-box fingerprints rely on signals that are fragile under a final-response interface, including full-text matching, soft behavioral features, or model-specific prompts designed not to transfer. We propose TCF (Targeted Counterfactual Fingerprinting), a black-box LLM fingerprinting framework that converts open-ended generation comparison into constrained-answer targeted counterfactual transfer. TCF restricts each verification query to a finite answer space, reducing the surface-form ambiguity that enters the verification score, and optimizes a prompt perturbation toward a counterfactual target different from the protected model's clean answer on the original prompt. Verification reduces to checking whether the suspect model's parsed final answer matches the recorded target. We introduce the source-model counterfactual margin (SCM), a protected-model-only quantity that certifies the target is unlikely before the perturbation and likely after it; SCM controls target selection, perturbation stopping, and fingerprint filtering. Under explicit derived-preservation and independent-transfer budgets motivated by local behavioral closeness, we derive a target-accuracy gap between derived and independent models. Across four LLM families, TCF achieves an average AUC of 0.9861, improving over TRAP, ProFLingo, and ZeroPrint by 0.07 to 0.19.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。