arXiv:2606.23872cs.LGcs.AI2026-06中稿 · ECCV

区分图像数据是真实训练样本还是模型生成的,提出新方法提升准确性。

MGI: Member vs Generated Inference

论文配图:MGI: Member vs Generated Inference
图 1 · 摘自论文原文
  • 结合自编码器与潜在生成器信号,分三阶段判断样本来源。
  • 在多种生成模型上准确识别真实训练样本与生成样本。
  • 适用于模型复现近似数据及衍生模型场景,适合隐私保护研究者。

随着生成模型产出的内容越来越接近人类创作,难以判断某个数据点是模型原始训练集的一部分,还是由模型生成的,尤其当模型记忆并再现训练数据时。我们将其定义为成员与生成推断(MGI):给定一个样本和目标生成模型,推断该样本是真实训练成员还是模型生成输出。针对图像生成,现有成员推理方法会系统性将生成样本误判为训练成员,而基于归因的方法则常将真实成员误判为生成样本。这一失败源于两类方法均依赖于类似增强的似然信号,对训练样本和模型自身输出均产生相似响应。为此,我们提出数据电路断路器(DCB),一种三阶段方法,融合生成模型自编码器与潜在生成器的互补信号,以区分训练成员与生成样本。在多种生成模型(包括图像自回归与扩散模型)上,DCB持续克服了传统方法的缺陷,即使在模型复制近似训练样本的情况下仍有效,并能推广至新型模型在生成数据上训练的挑战性设置。

原文摘要 · Abstract (English)

As generative models increasingly produce samples that are indistinguishable from human-created content, it becomes difficult to determine whether a given data point was part of a model's natural training set or was generated by the model itself, especially when models memorize and reproduce training data. We formalize this challenge as Member vs Generated Inference (MGI): given a sample and a target generative model, infer whether the sample is a true training member or a generated output of that model. Focusing on image generation, we show that existing membership inference methods systematically misclassify generated samples as training members, while attribution-based methods often misclassify true members as generated. This failure arises because both approaches rely on likelihood-related signals that are similarly elevated for training examples and for the model's own outputs. To address MGI, we propose Data Circuit Breaker (DCB), a three-stage method that combines complementary signals from a generative model's autoencoder and latent generator to distinguish training members from generated samples. Across multiple generative models, including image autoregressive and diffusion models, DCB consistently addresses the shortcomings of membership inference and attribution methods, remains effective even when models reproduce near-duplicates of training samples, and generalizes to challenging model derivative settings in which new models are trained on generated data.

生成模型成员推理隐私保护图像生成

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。