用少量查询提取模型,实现高效隐私攻击。
LoMime: Query-Efficient Membership Inference using Model Extraction in Label-Only Settings
- 通过主动采样与合成数据提取近似模型,降低查询开销。
- 仅需约1%训练样本的查询量即可达99%攻击准确率。
- 适合研究模型隐私漏洞或防御机制的开发者。
成员推理攻击(MIA)可揭示机器学习模型训练中是否包含特定数据点,威胁数据隐私。现有方法常依赖不切实际的假设,如访问公开数据集、影子模型、置信度分数或训练数据分布信息,易受置信度屏蔽和对抗正则化等防御手段影响。标签仅限的MIA在严格黑盒约束下仍需大量查询。本文提出一种基于可迁移性与模型提取的低成本标签仅限MIA框架。通过主动采样、基于扰动的选择及合成数据查询目标模型 $M$,提取功能相似的代理模型 $S$,并在 $S$ 上执行成员推理。该策略将查询负担集中在一次提取阶段,避免对 $M$ 的重复查询。在基准表格数据集上,仅需相当于测试约1%训练样本的查询预算,即可完成 $S$ 提取,并使成员推理准确率与直接攻击 $M$ 相比偏差不超过±1%。我们还评估了针对标签仅限MIA设计的标准防御(如DP-SGD和正则化)的有效性。初步结果表明,该框架可扩展至图像数据集上的深度神经网络,在标签仅限访问下展现良好可迁移性与推理性能,同时指明进一步优化方向。
原文摘要 · Abstract (English)
Membership inference attacks (MIAs) threaten the privacy of machine learning models by revealing whether a specific data point was used during training. Existing MIAs often rely on impractical assumptions, such as access to public datasets, shadow models, confidence scores, or knowledge of the training data distribution, making them vulnerable to defenses like confidence masking and adversarial regularization. Label-only MIAs, even under strict constraints, suffer from high query requirements per sample. We propose a cost-effective label-only MIA framework based on transferability and model extraction. By querying the target model $M$ using active sampling, perturbation-based selection, and synthetic data, we extract a functionally similar surrogate model $S$ on which membership inference is performed. This shifts the query overhead to a one-time extraction phase, eliminating repeated queries to $M$. Our method matches the performance of state-of-the-art label-only MIAs while significantly reducing query costs and operating under strict black-box constraints. On benchmark tabular datasets, we show that a query budget equivalent to testing the membership of approximately $1%$ of the training samples is sufficient to extract $S$ and achieve membership inference accuracy within $\pm 1%$ of that obtained when attacking $M$ directly. We also evaluate the effectiveness of standard defenses, including DP-SGD and regularization, proposed for label-only MIAs against our attack. Finally, we present preliminary results extending our framework to deep neural networks trained on image datasets, demonstrating promising transferability and membership inference performance under label-only access while highlighting directions for further optimization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。