arXiv:2501.06650cs.CRcs.DC2025-01被引 14

提出SafeSplit防御分裂学习中客户端后门攻击,能有效识别并过滤恶意行为。

SafeSplit: A Novel Defense Against Client-Side Backdoor Attacks in Split Learning (Full Version)

  • 通过循环反向分析与双模式检测,定位客户端引发的模型异常
  • 在多种数据分布和攻击场景下,后门成功率降至1.2%以下
  • 适合资源受限且需保护隐私的分布式模型训练场景

分裂学习(Split Learning, SL)是一种分布式深度学习方法,允许多个客户端与服务器协同训练和推理共享的深度神经网络(DNN),而无需共享私有本地数据。在该架构中,大多数网络层位于服务器端,少数初始层和输入在客户端侧,使资源受限客户端也能参与训练与推理。然而,其分布式结构使SL易受后门攻击:恶意客户端可篡改本地数据以改变DNN行为。现有联邦学习等框架的防御手段不适用于SL,且缺乏专为SL设计的有效后门防御。本文提出SafeSplit,首个针对客户端后门攻击的分裂学习防御机制。SafeSplit通过训练完成后执行循环反向分析,迭代回退至发现模型为良性的检查点,实现对恶意客户端行为的检测与过滤。其采用双重分析:一是频域静态分析,测量服务器层参数差异;二是动态分析,引入新型旋转距离度量,评估训练过程中服务器层参数方向变化。在多种数据分布、客户端数量和攻击场景下的全面评估表明,该双分析机制能有效缓解后门攻击,同时保持模型实用性。

原文摘要 · Abstract (English)

Split Learning (SL) is a distributed deep learning approach enabling multiple clients and a server to collaboratively train and infer on a shared deep neural network (DNN) without requiring clients to share their private local data. The DNN is partitioned in SL, with most layers residing on the server and a few initial layers and inputs on the client side. This configuration allows resource-constrained clients to participate in training and inference. However, the distributed architecture exposes SL to backdoor attacks, where malicious clients can manipulate local datasets to alter the DNN's behavior. Existing defenses from other distributed frameworks like Federated Learning are not applicable, and there is a lack of effective backdoor defenses specifically designed for SL. We present SafeSplit, the first defense against client-side backdoor attacks in Split Learning (SL). SafeSplit enables the server to detect and filter out malicious client behavior by employing circular backward analysis after a client's training is completed, iteratively reverting to a trained checkpoint where the model under examination is found to be benign. It uses a two-fold analysis to identify client-induced changes and detect poisoned models. First, a static analysis in the frequency domain measures the differences in the layer's parameters at the server. Second, a dynamic analysis introduces a novel rotational distance metric that assesses the orientation shifts of the server's layer parameters during training. Our comprehensive evaluation across various data distributions, client counts, and attack scenarios demonstrates the high efficacy of this dual analysis in mitigating backdoor attacks while preserving model utility.

分裂学习后门攻击安全防御分布式训练

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。