arXiv:2606.26257cs.LG2026-06中稿 · the 2nd Workshop o…

无需影子模型或预留数据,可准确估算模型训练中使用了数据集的多少。

Dataset Usage Inference without Shadow Models or Held-out Data

论文配图:Dataset Usage Inference without Shadow Models or Held-out Data
图 1 · 摘自论文原文
  • 用合成数据生成非成员样本,提取多种成员信号。
  • 将数据使用率估计转为混合比例问题,实现精准量化。
  • 适用于大模型和真实数据权属争议,实用性强。

模型训练中究竟使用了多少数据?数据使用推断(DUI)旨在通过估计数据集贡献比例来回答这一问题。然而现有方法依赖难以满足的实际假设:需训练昂贵的影子模型以模仿目标模型,且要求同时拥有已知训练样本和确认未参与训练的分布内预留数据集。这些限制使得当前方法在现代大模型及真实数据权属争议中难以应用。本文提出一种实用的DUI框架,摆脱了对影子模型和真实预留数据的依赖。我们的方法不依赖任何真实保留数据,而是生成合成非成员样本,提取多样化的成员信号,并将DUI建模为混合比例估计问题,从而推断候选数据集在训练中的使用比例。在大型图像生成模型上的实验表明,该方法能可靠地量化数据使用程度,为数据所有者提供了一种实用的工具,以判断其数据被用于模型训练的比例。

原文摘要 · Abstract (English)

How much of my data was used to train a machine learning model? Dataset Usage Inference (DUI) aims to answer this by estimating what fraction of a dataset contributed to a model's training. However, existing DUI methods rely on assumptions that rarely hold in practice: they require training expensive shadow models to imitate the target model, and they assume access to both known training samples and an in-distribution held-out set confirmed to be absent from training. These conditions make current approaches impractical for modern large models and real data ownership disputes. We introduce a practical DUI framework that removes these constraints. Our method requires neither shadow models nor real held-out data. Instead, it generates synthetic non-member samples, extracts diverse membership signals, and casts DUI as a mixture proportion estimation problem to estimate what share of the candidate dataset was used during training. Experiments on large image generative models show that our method reliably quantifies dataset usage, providing a practical tool for data owners to determine how much of their data was used to train a model.

数据使用率机器学习模型审计生成模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。