arXiv:2510.05699cs.CRcs.AI2025-10被引 3

攻击者可通过分词器推断数据是否被用于大模型训练,暴露隐私风险。

Membership Inference Attacks on Tokenizers of Large Language Models

  • 利用分词器作为新攻击入口,无需训练完整模型。
  • 在百万级网络文本上验证了主流大模型分词器存在成员泄露漏洞。
  • 提出自适应防御机制,适合关注模型隐私的开发者和研究者。

成员推理攻击(MIA)常用于评估机器学习模型的隐私风险。然而,当应用于预训练的大语言模型(LLMs)时,此类攻击面临诸多挑战,包括样本误标、分布偏移以及实验与真实场景中模型规模不一致等问题。为此,本文首次将分词器(tokenizer)作为新的攻击向量进行研究。分词器负责将原始文本转换为模型可处理的标记,其训练数据通常代表了预训练大模型所用的数据。与完整模型相比,分词器可从零开始高效训练,规避上述问题。尽管如此,分词器作为攻击载体的潜力仍鲜有探索。本文首次系统研究通过分词器进行成员推理的可能性,提出了五种攻击方法,并在数百万条互联网样本上进行了大量实验,揭示了当前先进大模型分词器中的隐私漏洞。为缓解这一新兴威胁,我们进一步设计了一种自适应防御策略。研究结果表明,分词器是被忽视但至关重要的隐私风险点,亟需针对其特点设计专用的隐私保护机制。

原文摘要 · Abstract (English)

Membership inference attacks (MIAs) are widely used to assess the privacy risks associated with machine learning models. However, when these attacks are applied to pre-trained large language models (LLMs), they encounter significant challenges, including mislabeled samples, distribution shifts, and discrepancies in model size between experimental and real-world settings. To address these limitations, we introduce tokenizers as a new attack vector for membership inference. Specifically, a tokenizer converts raw text into tokens for LLMs. Unlike full models, tokenizers can be efficiently trained from scratch, thereby avoiding the aforementioned challenges. In addition, the tokenizer's training data is typically representative of the data used to pre-train LLMs. Despite these advantages, the potential of tokenizers as an attack vector remains unexplored. To this end, we present the first study on membership leakage through tokenizers and explore five attack methods to infer dataset membership. Extensive experiments on millions of Internet samples reveal the vulnerabilities in the tokenizers of state-of-the-art LLMs. To mitigate this emerging risk, we further propose an adaptive defense. Our findings highlight tokenizers as an overlooked yet critical privacy threat, underscoring the urgent need for privacy-preserving mechanisms specifically designed for them.

隐私安全分词器大模型成员推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。