arXiv:2409.10643cs.CRcs.LG2024-09

无需数据即可高精度提取黑盒模型,且能自动识别类别数。

CaBaGe: Data-Free Model Extraction using ClAss BAlanced Generator Ensemble

  • 用经验回放聚焦难样本,提升学习效率。
  • 多生成器协同产多样数据,提升提取精度。
  • 无需知道类别数,可动态推断并高效攻击。

机器学习即服务(MLaaS)通常以按次查询的黑盒形式提供给用户。这种模式阻碍了结果的复现、验证与解释,也使白帽研究人员难以发现系统漏洞。模型提取技术可通过逆向工程黑盒模型来应对这些挑战。由于训练数据通常不可获取,本文聚焦于更现实的数据自由模型提取场景。我们提出一种名为CaBaGe的新方法,在少量查询下实现更高精度的模型提取。创新包括:(1)一种聚焦困难样本的经验回放机制;(2)多个生成器组成的集成,持续生成多样化合成数据;(3)选择性过滤机制,仅对更难且更平衡的样本发起查询。此外,我们首次构建了一个更真实的情境——攻击者未知目标模型训练数据的类别数量,并提出了实时学习类别数的方法。实验表明,CaBaGe在七个数据集(MNIST、FMNIST、SVHN、CIFAR-10、CIFAR-100、ImageNet-subset、Tiny ImageNet)上均优于现有方法,提取模型准确率最高提升43.13%;同时,达到先前工作最终准确率所需的查询次数最多减少75.7%。

原文摘要 · Abstract (English)

Machine Learning as a Service (MLaaS) is often provided as a pay-per-query, black-box system to clients. Such a black-box approach not only hinders open replication, validation, and interpretation of model results, but also makes it harder for white-hat researchers to identify vulnerabilities in the MLaaS systems. Model extraction is a promising technique to address these challenges by reverse-engineering black-box models. Since training data is typically unavailable for MLaaS models, this paper focuses on the realistic version of it: data-free model extraction. We propose a data-free model extraction approach, CaBaGe, to achieve higher model extraction accuracy with a small number of queries. Our innovations include (1) a novel experience replay for focusing on difficult training samples; (2) an ensemble of generators for steadily producing diverse synthetic data; and (3) a selective filtering process for querying the victim model with harder, more balanced samples. In addition, we create a more realistic setting, for the first time, where the attacker has no knowledge of the number of classes in the victim training data, and create a solution to learn the number of classes on the fly. Our evaluation shows that CaBaGe outperforms existing techniques on seven datasets -- MNIST, FMNIST, SVHN, CIFAR-10, CIFAR-100, ImageNet-subset, and Tiny ImageNet -- with an accuracy improvement of the extracted models by up to 43.13%. Furthermore, the number of queries required to extract a clone model matching the final accuracy of prior work is reduced by up to 75.7%.

模型提取黑盒攻击无数据训练生成对抗

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。