arXiv:2410.03067cs.LGcs.CR2024-10

提出 FedCert 方法,评估联邦学习模型在客户端数据扰动下的鲁棒性。

FedCert: Federated Accuracy Certification

  • 基于客户端认证准确率和类别分布估算全局模型鲁棒性。
  • 在 CIFAR-10/100 上相比基线方法显著降低估计误差。
  • 适用于关注联邦学习安全性的研究人员与工程师。

联邦学习(FL)作为一种去中心化训练范式,通过将本地数据保留在客户端来保护数据隐私。然而,评估模型在客户端数据扰动下的鲁棒性仍具挑战。已有研究在集中式训练中基于认证准确率评估模型抗扰动能力,但难以扩展至联邦学习,因客户端本地数据未知。本文提出 FedCert,首次实现对联邦学习系统鲁棒性的评估。该方法基于各客户端的认证准确率与类别分布,近似全局模型的认证准确率。针对现实场景中数据非独立同分布(Non-IID)的问题,引入客户端分组算法以确保聚合步骤中的可靠估计。理论分析证明了 FedCert 的有效性,实验在 CIFAR-10 与 CIFAR-100 数据集上多种场景下均显示其估计误差显著低于基线方法。本工作为评估联邦学习系统的可靠性提供了可行方案,并为未来研究奠定基础。源代码见 https://github.com/thanhhff/FedCert/。

原文摘要 · Abstract (English)

Federated Learning (FL) has emerged as a powerful paradigm for training machine learning models in a decentralized manner, preserving data privacy by keeping local data on clients. However, evaluating the robustness of these models against data perturbations on clients remains a significant challenge. Previous studies have assessed the effectiveness of models in centralized training based on certified accuracy, which guarantees that a certain percentage of the model's predictions will remain correct even if the input data is perturbed. However, the challenge of extending these evaluations to FL remains unresolved due to the unknown client's local data. To tackle this challenge, this study proposed a method named FedCert to take the first step toward evaluating the robustness of FL systems. The proposed method is designed to approximate the certified accuracy of a global model based on the certified accuracy and class distribution of each client. Additionally, considering the Non-Independent and Identically Distributed (Non-IID) nature of data in real-world scenarios, we introduce the client grouping algorithm to ensure reliable certified accuracy during the aggregation step of the approximation algorithm. Through theoretical analysis, we demonstrate the effectiveness of FedCert in assessing the robustness and reliability of FL systems. Moreover, experimental results on the CIFAR-10 and CIFAR-100 datasets under various scenarios show that FedCert consistently reduces the estimation error compared to baseline methods. This study offers a solution for evaluating the robustness of FL systems and lays the groundwork for future research to enhance the dependability of decentralized learning. The source code is available at https://github.com/thanhhff/FedCert/.

联邦学习鲁棒性评估认证准确率

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。