arXiv:2504.00170cs.CRcs.AI2025-04被引 2

通过多云复现训练步骤,检测模型中隐藏的后门攻击。

Backdoor Detection through Replicated Execution of Outsourced Training

  • 利用多个云服务商并行复现部分训练过程,对比模型更新差异。
  • 在50%云服务存在后门时,仍可识别99.6%的恶意服务器。
  • 适合计算资源有限的客户端,无需人工标注或复杂计算。

将机器学习模型训练外包给云服务商已成为常见做法。客户虽能享受规模经济,但需隐含信任:服务器应严格遵循客户的训练流程。恶意服务器可能在模型中植入后门。在不了解后门攻击方式及触发机制的情况下,检测此类模型仍是难题。本文提出,若客户可访问多个云服务商,可通过在多个服务器上复现部分训练步骤,类似差分测试的方式检测训练过程中的偏差。假设部分云服务商为良性,可通过模型更新的显著差异识别恶意服务器——即后门注入与正常训练产生的更新存在明显不同。本方法的最大优势在于适用于本地计算能力有限的客户,仅依赖多云环境即可完成检测,无需昂贵的人工标注或高算力。我们在一个外包监督学习任务中验证了该方法:当50%的云服务商植入自定义后门时,本方法可正确识别99.6%的恶意方。本质而言,该方法将现有基于特征的检测范式升级为基于异常的检测范式。此外,该方法对知晓检测机制的自适应攻击者也具备鲁棒性。

原文摘要 · Abstract (English)

It is common practice to outsource the training of machine learning models to cloud providers. Clients who do so gain from the cloud's economies of scale, but implicitly assume trust: the server should not deviate from the client's training procedure. A malicious server may, for instance, seek to insert backdoors in the model. Detecting a backdoored model without prior knowledge of both the backdoor attack and its accompanying trigger remains a challenging problem. In this paper, we show that a client with access to multiple cloud providers can replicate a subset of training steps across multiple servers to detect deviation from the training procedure in a similar manner to differential testing. Assuming some cloud-provided servers are benign, we identify malicious servers by the substantial difference between model updates required for backdooring and those resulting from clean training. Perhaps the strongest advantage of our approach is its suitability to clients that have limited-to-no local compute capability to perform training; we leverage the existence of multiple cloud providers to identify malicious updates without expensive human labeling or heavy computation. We demonstrate the capabilities of our approach on an outsourced supervised learning task where $50\%$ of the cloud providers insert their own backdoor; our approach is able to correctly identify $99.6\%$ of them. In essence, our approach is successful because it replaces the signature-based paradigm taken by existing approaches with an anomaly-based detection paradigm. Furthermore, our approach is robust to several attacks from adaptive adversaries utilizing knowledge of our detection scheme.

后门检测多云安全异常检测模型可信

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。