图像自回归模型隐私风险远高于扩散模型,易被攻破
Privacy Attacks on Image AutoRegressive Models
- 设计新成员推断攻击,精准识别训练图像
- 仅需4张样本即可泄露数据集信息,远低于扩散模型的200张
- 实测可提取数百张训练图像,适合关注安全性的研究者
图像自回归生成已成为一种强大范式,其模型(IARs)在图像质量上已媲美扩散模型(FID: 1.48 vs. 1.58),且生成速度更快。然而,IARs的隐私风险尚未被充分研究,引发部署担忧。本文首次系统分析IARs的隐私漏洞,将其与扩散模型(DMs)对比。我们提出一种新型成员推断攻击(MIA),在假阳性率为1%时,检测准确率达94.57%,远超对应扩散模型的6.38%。利用该攻击,我们实现数据集推断(DI),仅需4个样本即可确认成员身份,而扩散模型需200个。此外,我们成功从VAR-d30模型中提取出698张训练图像。结果表明:尽管IARs在生成质量与速度上更优,但其隐私脆弱性显著高于性能相当的扩散模型。代码已开源。
原文摘要 · Abstract (English)
Image AutoRegressive generation has emerged as a new powerful paradigm with image autoregressive models (IARs) matching state-of-the-art diffusion models (DMs) in image quality (FID: 1.48 vs. 1.58) while allowing for a higher generation speed. However, the privacy risks associated with IARs remain unexplored, raising concerns regarding their responsible deployment. To address this gap, we conduct a comprehensive privacy analysis of IARs, comparing their privacy risks to the ones of DMs as reference points. Concretely, we develop a novel membership inference attack (MIA) that achieves a remarkably high success rate in detecting training images (with True Positive Rate at False Positive Rate = 1% of 94.57% vs. 6.38% for DMs with comparable attacks). We leverage our novel MIA to provide dataset inference (DI) for IARs, and show that it requires as few as 4 samples to detect dataset membership (compared to 200 for DI in DMs), confirming a higher information leakage in IARs. Finally, we are able to extract hundreds of training data points from an IAR (e.g., 698 from VAR-\textit{d}30). Our results suggest a fundamental privacy-utility trade-off: while IARs excel in image generation quality and speed, they are \textit{empirically} significantly more vulnerable to privacy attacks compared to DMs that achieve similar performance. We release the code at https://github.com/sprintml/privacy_attacks_against_iars for reproducibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。