arXiv:2604.00419cs.LGcs.AI2026-04中稿 · ICPR-2026 conferen…被引 5

通过梯度扰动检测大模型训练数据成员身份,效果远超传统方法。

G-Drift MIA: Membership Inference via Gradient-Induced Feature Drift in LLMs

  • 利用梯度上升引发特征漂移,捕捉训练样本的内在痕迹。
  • 在多个模型和数据集上,攻击成功率显著高于基于置信度或困惑度的方法。
  • 适合关注大模型隐私风险与数据审计的研究者使用。

大规模语言模型(LLMs)在海量网络语料上训练,引发隐私与版权担忧。成员推断攻击(MIAs)旨在判断某条数据是否曾用于训练。现有LLM MIAs多依赖输出概率或损失值,在成员与非成员来自同一分布时,性能仅略优于随机猜测。本文提出G-Drift MIA,一种基于梯度诱导特征漂移的白盒攻击方法。针对候选样本(x,y),执行一次定向梯度上升以提高其损失,并测量内部表示(包括logits、隐藏层激活、固定特征方向投影)在更新前后的变化。这些漂移信号用于训练轻量级逻辑回归分类器,有效区分成员与非成员。在多个基于Transformer的LLM及真实基准数据集上,G-Drift显著优于基于置信度、困惑度和参考的攻击方法。进一步发现,被记忆的训练样本表现出更小且更结构化的特征漂移,揭示了梯度几何、表征稳定性与记忆之间的机制联系。总体而言,微小可控的梯度干预为审计训练数据成员身份和评估大模型隐私风险提供了实用工具。

原文摘要 · Abstract (English)

Large language models (LLMs) are trained on massive web-scale corpora, raising growing concerns about privacy and copyright. Membership inference attacks (MIAs) aim to determine whether a given example was used during training. Existing LLM MIAs largely rely on output probabilities or loss values and often perform only marginally better than random guessing when members and non-members are drawn from the same distribution. We introduce G-Drift MIA, a white-box membership inference method based on gradient-induced feature drift. Given a candidate (x,y), we apply a single targeted gradient-ascent step that increases its loss and measure the resulting changes in internal representations, including logits, hidden-layer activations, and projections onto fixed feature directions, before and after the update. These drift signals are used to train a lightweight logistic classifier that effectively separates members from non-members. Across multiple transformer-based LLMs and datasets derived from realistic MIA benchmarks, G-Drift substantially outperforms confidence-based, perplexity-based, and reference-based attacks. We further show that memorized training samples systematically exhibit smaller and more structured feature drift than non-members, providing a mechanistic link between gradient geometry, representation stability, and memorization. In general, our results demonstrate that small, controlled gradient interventions offer a practical tool for auditing the membership of training-data and assessing privacy risks in LLMs.

成员推断大模型隐私梯度分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。