arXiv:2411.10673cs.LGcs.CR2024-11被引 1

提出垂直防御方法VERT,有效应对超大规模模型投毒攻击

How to Defend Against Large-scale Model Poisoning Attacks in Federated Learning: A Vertical Solution

  • 以通信轮次为垂直轴,用历史梯度预测用户更新
  • 在80%以上投毒攻击下仍保持模型收敛性
  • 支持不同计算能力服务器的轻量化部署

联邦学习因分布式特性易受模型投毒攻击。现有防御从每轮所有用户梯度出发(水平方案),在大规模(>50%)攻击下完全失效。本文基于模型收敛过程高度可预测的洞察,创新性地将最优聚合梯度求解转为垂直方案。提出VERT:以全局通信轮次为垂直轴,利用历史梯度信息训练预测器,通过比较预测与实际梯度相似性,精准高效筛选最优聚合梯度。为降低计算复杂度,设计低维向量投影器,将用户梯度压缩至可接受长度后进行后续训练与预测。大量实验表明,VERT在不同联邦学习场景下均具高效可扩展性,对≥80%的模型投毒攻击有显著防御效果。此外,可针对不同模型结构设计投影器,适配不同算力的聚合服务器。

原文摘要 · Abstract (English)

Federated learning (FL) is vulnerable to model poisoning attacks due to its distributed nature. The current defenses start from all user gradients (model updates) in each communication round and solve for the optimal aggregation gradients (horizontal solution). This horizontal solution will completely fail when facing large-scale (>50%) model poisoning attacks. In this work, based on the key insight that the convergence process of the model is a highly predictable process, we break away from the traditional horizontal solution of defense and innovatively transform the problem of solving the optimal aggregation gradients into a vertical solution problem. We propose VERT, which uses global communication rounds as the vertical axis, trains a predictor using historical gradients information to predict user gradients, and compares the similarity with actual user gradients to precisely and efficiently select the optimal aggregation gradients. In order to reduce the computational complexity of VERT, we design a low dimensional vector projector to project the user gradients to a computationally acceptable length, and then perform subsequent predictor training and prediction tasks. Exhaustive experiments show that VERT is efficient and scalable, exhibiting excellent large-scale (>=80%) model poisoning defense effects under different FL scenarios. In addition, we can design projector with different structures for different model structures to adapt to aggregation servers with different computing power.

联邦学习投毒攻击防御机制垂直方案

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。