arXiv:2510.02962cs.CL2025-10被引 8

用不可见水印检测大模型是否偷偷用了受版权保护的数据

Leave No TRACE: Black-box Detection of Copyrighted Dataset Usage in Large Language Models via Watermarking

  • 用私钥无损打水印,保持文本质量和任务性能
  • 通过高不确定词元熵筛选,显著提升检测灵敏度
  • 无需内部信息或干净参考集,适合真实场景验证

大型语言模型(LLMs)越来越依赖小规模领域数据微调以提升下游表现,但这些数据常含受版权保护内容,亟需可靠防护机制。现有成员推断攻击(MIAs)和数据集推断方法通常需访问内部信号如logits,而当前黑盒方法多依赖手工提示或干净参考数据集校准,实用性受限。水印技术虽具潜力,但以往方法易降低文本质量或影响任务性能。本文提出TRACE框架,实现完全黑盒检测模型对受版权数据的使用。该方法利用私钥在数据集上无损嵌入水印,确保文本质量与下游任务可用性。检测时,基于微调引入的水印放射性效应,设计熵门控机制,仅对高不确定性词元进行评分,大幅提升检测能力。在多种数据集与模型族中,TRACE均实现显著检测效果(p<0.05),常具极强统计证据。同时支持多数据集溯源,且在持续预训练于大规模非水印语料后仍保持鲁棒性。本工作为受版权数据使用提供实用、可靠的黑盒验证路径。代码将开源于:https://github.com/NusIoraPrivacy/TRACE。

原文摘要 · Abstract (English)

Large Language Models (LLMs) are increasingly fine-tuned on smaller, domain-specific datasets to improve downstream performance. These datasets often contain proprietary or copyrighted material, raising the need for reliable safeguards against unauthorized use. Existing membership inference attacks (MIAs) and dataset-inference methods typically require access to internal signals such as logits, while current black-box approaches often rely on handcrafted prompts or a clean reference dataset for calibration, both of which limit practical applicability. Watermarking is a promising alternative, but prior techniques can degrade text quality or reduce task performance. We propose TRACE, a practical framework for fully black-box detection of copyrighted dataset usage in LLM fine-tuning. \texttt{TRACE} rewrites datasets with distortion-free watermarks guided by a private key, ensuring both text quality and downstream utility. At detection time, we exploit the radioactivity effect of fine-tuning on watermarked data and introduce an entropy-gated procedure that selectively scores high-uncertainty tokens, substantially amplifying detection power. Across diverse datasets and model families, TRACE consistently achieves significant detections (p<0.05), often with extremely strong statistical evidence. Furthermore, it supports multi-dataset attribution and remains robust even after continued pretraining on large non-watermarked corpora. These results establish TRACE as a practical route to reliable black-box verification of copyrighted dataset usage. We will make our code available at: https://github.com/NusIoraPrivacy/TRACE.

版权检测水印技术大模型安全

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。