提出新方法检测自回归图像模型训练数据,揭示大模型数据泄露风险。
ICAS: Detecting Training Data from Autoregressive Image Generative Models
- 通过隐式分词分类与自适应得分聚合定位训练数据
- 在图文生成和类别条件场景中检测准确率显著提升
- 发现大模型存在线性可扩展的成员推理漏洞,适合隐私安全研究者
自回归图像生成模型快速发展,以尺度级视觉自回归为代表,推动了图像合成能力的边界。然而,这些进展也引发数据隐私与版权的重大担忧。为此,训练数据检测成为识别模型训练中未经授权数据使用的关键任务。本文首次将成员推理应用于该领域,提出包含隐式分词分类与自适应得分聚合策略的方法。首先计算查询图像中每个分词的隐式分类得分,再通过自适应策略整合得分,重点强化低分分词的影响。最终得分越高,样本越可能来自训练集。我们适配了原本为LLM设计的检测算法至视觉自回归模型,实验表明本方法在类别条件和文本到图像场景中均表现更优。此外,在多种数据变换下仍具备强鲁棒性与泛化能力。关键发现包括:(1)成员推理存在线性缩放规律,暴露大型基础模型的脆弱性;(2)尺度级视觉自回归模型的训练数据比其他自回归范式更易被检测。代码已开源。
原文摘要 · Abstract (English)
Autoregressive image generation has witnessed rapid advancements, with prominent models such as scale-wise visual auto-regression pushing the boundaries of visual synthesis. However, these developments also raise significant concerns regarding data privacy and copyright. In response, training data detection has emerged as a critical task for identifying unauthorized data usage in model training. To better understand the vulnerability of autoregressive image generative models to such detection, we conduct the first study applying membership inference to this domain. Our approach comprises two key components: implicit classification and an adaptive score aggregation strategy. First, we compute the implicit token-wise classification score within the query image. Then we propose an adaptive score aggregation strategy to acquire a final score, which places greater emphasis on the tokens with lower scores. A higher final score indicates that the sample is more likely to be involved in the training set. To validate the effectiveness of our method, we adapt existing detection algorithms originally designed for LLMs to visual autoregressive models. Extensive experiments demonstrate the superiority of our method in both class-conditional and text-to-image scenarios. Moreover, our approach exhibits strong robustness and generalization under various data transformations. Furthermore, sufficient experiments suggest two novel key findings: (1) A linear scaling law on membership inference, exposing the vulnerability of large foundation models. (2) Training data from scale-wise visual autoregressive models is easier to detect than other autoregressive paradigms. Our code is available at https://github.com/Chrisqcwx/ImageAR-MIA.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。