arXiv:2608.01023cs.LGcs.AI2026-08中稿 · ProvSec 2026

Caliber通过动态加噪保护模型免受知识蒸馏攻击,兼顾防御强度与可用性。

Caliber: Cross-Architecture Extraction-Cost Control for Score-Returning APIs

论文配图:Caliber: Cross-Architecture Extraction-Cost Control for Score-Returning APIs
图 1 · 摘自论文原文
  • 根据任务特性自适应调节高斯噪声强度,平衡防御与精度。
  • 在30+模型-数据组合上误差仅0.6%-1.4%,逼近理论最优。
  • 适合需防止模型盗取的工业级推理服务部署。

我们提出Caliber,一种针对模型提取攻击的输出扰动防御机制,将噪声选择建模为校准问题:既要控制训练代理模型时监督信号的退化程度,又要保证恢复原始logits的每输入查询成本可证明下界。为抵御利用返回分数进行知识蒸馏的攻击,Caliber向内部logits添加独立同分布的高斯噪声。我们建立两个性质:单调一致性退化——当干净logits有唯一最大值时,与真实预测的一致性随噪声尺度严格下降,每个目标值(1/K,1)对应唯一正尺度;任务准确率被可计算的上下界约束。每输入恢复成本:推导出固定输入下恢复干净logits所需重复查询次数的闭式极小极大下界。Caliber将噪声方差归一化为平方中位数前两名logit差距,并用逻辑曲线拟合噪声-效用关系,支持按模型或任务共享校准。在超过三十个模型-数据组合上,模型级校准的平均绝对相对误差为0.6%-1.4%。端到端实验显示,代理模型性能普遍跟随配置的退化程度变化,而固定输入平均则符合预期方差缩减规律。

原文摘要 · Abstract (English)

We present Caliber, an output-perturbation defense against model extraction that formulates noise selection as a calibration problem: how much the defense degrades the supervision signal used to train a surrogate, and the provable per-input query cost of recovering the clean logits. To defend against an attacker that uses returned scores for knowledge distillation, Caliber adds independent and identically distributed Gaussian noise to the internal logits. We establish two properties of the resulting perturbed predictions. Monotone agreement degradation: When the clean logits have a unique maximizer, agreement with the clean prediction decreases strictly with the noise scale, so every target in $(1/K,1)$ corresponds to a unique positive scale; task accuracy is bounded by computable lower and upper envelopes. Per-input recovery cost: We derive a closed-form minimax lower bound on the repeated queries needed to recover the clean logits for a fixed input. Caliber normalizes noise variance by the squared median top-two logit margin and fits the resulting noise-utility relationship with a logistic curve, either per model or shared within a task. Across more than thirty model-dataset combinations, per-model calibration achieves mean absolute relative errors of 0.6-1.4%. End-to-end experiments show that surrogate performance generally tracks the configured degradation, while fixed-input averaging follows the expected variance reduction.

模型安全防御机制知识蒸馏

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。