arXiv:2512.08875cs.LGcs.AI2025-12被引 4

LLM生成表格数据时会泄露训练数据中的数字模式,存在隐私风险。

When Tables Leak: Attacking String Memorization in LLM-Based Tabular Data Generation

  • 通过分析生成数据中的数字序列,设计无须模型内部信息的隐私攻击方法。
  • 在多个模型和数据集上成功识别出训练数据成员,部分模型达到完美分类。
  • 提出新采样策略扰动数字生成,有效防御攻击且保持数据质量。

大型语言模型(LLMs)在生成高质量合成表格数据方面表现出色。实践中,主要采用两种方法:(i) 在表格数据上微调小型模型,(ii) 用上下文示例提示大型模型。本文发现,这两种范式均存在隐私泄露风险——会复现训练数据中数字序列的记忆模式。为此,我们提出一种名为LevAtt的无框成员推断攻击(No-box MIA),仅需访问生成的合成数据,针对合成观测中的数字字符串进行攻击。实验表明,该攻击在多种模型与数据集上均造成显著隐私泄露,甚至在先进模型上实现完美成员判定。研究揭示了基于LLM的合成数据生成特有的隐私漏洞,亟需有效防御。为此,我们提出两种方法,包括一种新型采样策略,在生成过程中有策略地扰动数字。评估显示,该方法可有效抵御攻击,同时对合成数据的真实性与实用性影响极小。

原文摘要 · Abstract (English)

Large Language Models (LLMs) have recently demonstrated remarkable performance in generating high-quality tabular synthetic data. In practice, two primary approaches have emerged for adapting LLMs to tabular data generation: (i) fine-tuning smaller models directly on tabular datasets, and (ii) prompting larger models with examples provided in context. In this work, we show that popular implementations from both regimes exhibit a tendency to compromise privacy by reproducing memorized patterns of numeric digits from their training data. To systematically analyze this risk, we introduce a simple No-box Membership Inference Attack (MIA) called LevAtt that assumes adversarial access to only the generated synthetic data and targets the string sequences of numeric digits in synthetic observations. Using this approach, our attack exposes substantial privacy leakage across a wide range of models and datasets, and in some cases, is even a perfect membership classifier on state-of-the-art models. Our findings highlight a unique privacy vulnerability of LLM-based synthetic data generation and the need for effective defenses. To this end, we propose two methods, including a novel sampling strategy that strategically perturbs digits during generation. Our evaluation demonstrates that this approach can defeat these attacks with minimal loss of fidelity and utility of the synthetic data.

隐私安全数据生成大模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。