arXiv:2505.20955cs.CRcs.LG2025-05中稿 · ICML被引 2

从频域角度发现扩散模型隐私漏洞,提出高效过滤模块提升攻击效果。

Enhancing Membership Inference Attacks on Diffusion Models from a Frequency-Domain Perspective

  • 发现扩散模型处理高频信息能力弱,导致误判成员数据
  • 提出的高频滤波模块使基线攻击性能显著提升
  • 插件式设计无需额外计算,适配各类成员推理攻击

扩散模型在图像生成中取得巨大成功,但也引发隐私与版权担忧。成员推理攻击(MIAs)旨在判断特定数据是否用于模型训练。现有针对扩散模型的攻击多依赖模型的图像生成能力,本文将其统一为一个通用范式,并计算成员得分以识别成员数据。实验发现,现有攻击忽视了扩散模型在高频信息处理上的固有缺陷:高频内容较多的成员数据易被误判为外部数据,而高频较少的外部数据则常被误判为成员数据。理论分析表明,该缺陷削弱了攻击的成员优势,干扰了对成员与外部数据的有效区分。基于此,我们提出一种即插即用的高频滤波模块,可无缝集成至该范式中的任意攻击,且不增加额外时间成本。大量实验证明,该模块在多个数据集和模型上均显著提升了基线攻击性能。代码已公开于 https://github.com/poetic2/FreMIA。

原文摘要 · Abstract (English)

Diffusion models have achieved tremendous success in image generation, but they also raise significant concerns regarding privacy and copyright issues. Membership Inference Attacks (MIAs) are designed to ascertain whether specific data was utilized during a model's training phase. As current MIAs for diffusion models typically exploit the model's image prediction ability, we formalize them into a unified general paradigm that computes the membership score for membership identification. Under this paradigm, we empirically find that existing attacks overlook the inherent deficiency in how diffusion models process high-frequency information. Consequently, this deficiency leads to member data with more high-frequency content being misclassified as hold-out data, and hold-out data with less high-frequency content tends to be misclassified as member data. Moreover, we theoretically demonstrate that this deficiency reduces the membership advantage of attacks, thereby interfering with the effective discrimination of member data and hold-out data. Based on this insight, we propose a plug-and-play high-frequency filter module to mitigate the adverse effects of the deficiency, which can be seamlessly integrated into any attacks within the general paradigm without additional time costs. Extensive experiments corroborate that this module significantly improves the performance of baseline attacks across different datasets and models. Code is available at https://github.com/poetic2/FreMIA.

隐私攻击扩散模型频域分析成员推理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。