提出抗拜占庭攻击的多任务表示学习框架,实现个性化模型与系统鲁棒性兼顾。
Byzantine Resilient Federated Multi-Task Representation Learning
- 共享神经网络结构,客户端仅自定义最后层以适配个性化需求。
- 在CIFAR-10和FEMNIST上验证,即使存在恶意节点仍保持高准确率。
- 适用于异构设备环境,尤其适合数据少的新客户端快速适应。
本文提出BR-MTRL框架,一种可抵御故障或恶意客户端的联邦多任务表示学习方法。该方法通过共享神经网络实现特征学习,各客户端共享固定层,仅末尾层个性化。采用交替梯度下降策略:客户端优化本地模型、更新自身最后一层,并将共享表示发送至中心服务器聚合。为防御拜占庭攻击,引入几何中位数和Krum两种鲁棒聚合方法。实验基于AWS构建联邦测试平台,使用真实数据集如CIFAR-10和FEMNIST进行评估,结果表明该方法在存在拜占庭对手时仍具备高效性与鲁棒性,且能有效迁移至新客户端(数据有限)。
原文摘要 · Abstract (English)
In this paper, we propose BR-MTRL, a Byzantine-resilient multi-task representation learning framework that handles faulty or malicious agents. Our approach leverages representation learning through a shared neural network model, where all clients share fixed layers, except for a client-specific final layer. This structure captures shared features among clients while enabling individual adaptation, making it a promising approach for leveraging client data and computational power in heterogeneous federated settings to learn personalized models. To learn the model, we employ an alternating gradient descent strategy: each client optimizes its local model, updates its final layer, and sends estimates of the shared representation to a central server for aggregation. To defend against Byzantine agents, we employ two robust aggregation methods for client-server communication, Geometric Median and Krum. Our method enables personalized learning while maintaining resilience in distributed settings. We implemented the proposed algorithm in a federated testbed built using Amazon Web Services (AWS) platform and compared its performance with various benchmark algorithms and their variations. Through experiments using real-world datasets, including CIFAR-10 and FEMNIST, we demonstrated the effectiveness and robustness of our approach and its transferability to new unseen clients with limited data, even in the presence of Byzantine adversaries.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。