arXiv:2506.02362cs.CRcs.AI2025-06被引 8

用集成蒸馏模型防御黑盒模型窃取,不依赖异常数据假设。

MISLEADER: Defending against Model Extraction with Ensembles of Distilled Models

  • 构建双层优化框架,兼顾正常输入精度与防复制能力。
  • 在多种场景下实现高保真度且有效抵抗模型提取攻击。
  • 适合需要保护AI服务知识产权的厂商使用。

模型窃取攻击通过查询访问试图复现黑盒模型的功能,威胁机器学习即服务(MLaaS)提供商的知识产权。现有防御多依赖攻击样本为分布外(OOD)的假设,但现代模型训练数据多样、攻击者查询预算有限,该假设日益不可靠,导致防御效果大打折扣。为此,我们提出MISLEADER(enseMbles of dIStiLled modEls Against moDel ExtRaction),一种无需依赖OOD假设的新防御策略。MISLEADER将模型保护建模为双层优化问题,同时保证良性输入上的预测保真度并降低潜在克隆模型的可提取性。框架结合数据增强模拟攻击查询,并采用异构蒸馏模型集成以提升鲁棒性与多样性。我们还提供了可计算的近似算法,并推导了理论误差界来刻画防御有效性。大量实验验证了该策略在保持模型实用性的同时具备强抗提取能力。代码已开源:https://github.com/LabRAI/MISLEADER。

原文摘要 · Abstract (English)

Model extraction attacks aim to replicate the functionality of a black-box model through query access, threatening the intellectual property (IP) of machine-learning-as-a-service (MLaaS) providers. Defending against such attacks is challenging, as it must balance efficiency, robustness, and utility preservation in the real-world scenario. Despite the recent advances, most existing defenses presume that attacker queries have out-of-distribution (OOD) samples, enabling them to detect and disrupt suspicious inputs. However, this assumption is increasingly unreliable, as modern models are trained on diverse datasets and attackers often operate under limited query budgets. As a result, the effectiveness of these defenses is significantly compromised in realistic deployment scenarios. To address this gap, we propose MISLEADER (enseMbles of dIStiLled modEls Against moDel ExtRaction), a novel defense strategy that does not rely on OOD assumptions. MISLEADER formulates model protection as a bilevel optimization problem that simultaneously preserves predictive fidelity on benign inputs and reduces extractability by potential clone models. Our framework combines data augmentation to simulate attacker queries with an ensemble of heterogeneous distilled models to improve robustness and diversity. We further provide a tractable approximation algorithm and derive theoretical error bounds to characterize defense effectiveness. Extensive experiments across various settings validate the utility-preserving and extraction-resistant properties of our proposed defense strategy. Our code is available at https://github.com/LabRAI/MISLEADER.

模型安全防御机制蒸馏模型

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。