arXiv:2604.01904cs.CRcs.AI2026-04

提出新方法检测大模型训练中的数据洗白,即使原始数据被改写也能找回记忆痕迹。

Combating Data Laundering in LLM Training

  • 用辅助模型生成类训练文本,逆向推导数据洗白过程
  • 在多个模型和洗白策略下恢复检测信号,准确率显著提升
  • 适合关注数据版权保护的研究者和审计人员

大语言模型训练后的未经授权数据检测通常依赖‘原始数据查询’模式:权利方将原始专有数据输入目标模型,若其产生更强的记忆信号(如更高置信度或更低损失),则判定为训练过。我们发现,当训练数据被语义保留但风格或结构改变的替代品(即数据洗白)覆盖时,该机制失效——因暴露发生在洗白形式,原始数据不再触发记忆信号,导致检测信号断裂。为此,我们提出基于原始数据与参考语料库、仅通过查询访问目标模型的新检测框架,即使洗白方式未知。由于无法精确还原洗白数据,我们利用辅助模型推断出对检测有用的合成路径。为使搜索可行,引入合成数据反演(SDR),通过‘目标-细节’抽象约束自然语言变换空间(如‘诗意重写’+‘生动意象’),识别最可能的变换目标并迭代优化细节,使生成查询能激发更强的检测信号。在MIMIR基准上评估,针对Pythia、Llama2、Falcon等多类模型及多种洗白策略,SDR均有效恢复检测信号,提供实用的数据审计能力。

原文摘要 · Abstract (English)

Post-hoc unauthorized-training data detection for large language models (LLMs) typically assumes a query-with-originals regime: rights holders query a target LLM with raw proprietary data and assess whether the model assigns them stronger memorization-based detection signals, e.g., higher confidence or lower loss, than held-out non-training reference texts. We show that this regime becomes brittle under data laundering, where the target LLM is trained on semantics-preserving but stylistically or structurally transformed surrogates of proprietary data to obfuscate provenance. Since training-time exposure occurs in the laundered form, memorization signals may no longer appear on the originals, collapsing the candidate-reference signal separation that standard detectors rely on. We counter this threat by studying laundering-aware detection with raw proprietary data, a held-out reference corpus, and query access to the target LLM, while the laundering transformation is undisclosed. Since exact recovery of the laundered corpus is infeasible, we infer a detection-useful synthesis process via an auxiliary LLM that maps originals into training-like queries. To make this search tractable, we introduce Synthesis Data Reversion (SDR), which constrains the unbounded space of natural-language transformations through a goal-details abstraction: a high-level transformation goal, e.g., "lyrical rewriting", and fine-grained details, e.g., "with vivid imagery". SDR identifies the most likely goal and iteratively refines details so synthesized queries elicit stronger target-model detection signals. Evaluated on the MIMIR benchmark against diverse laundering practices and target LLM families (Pythia, Llama2, and Falcon), SDR consistently restores detection signals, offering a practical auditing layer against data laundering.

数据安全模型审计洗白检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。