应对数据污染与模型异构的联邦学习新框架,提升系统鲁棒性。
Robust Asymmetric Heterogeneous Federated Learning with Corrupted Clients
- 用混合增强数据做有监督对比学习,增强模型抗干扰能力。
- 设计单向选择性学习策略,避免接收低质量更新。
- 适用于真实场景中存在恶意或异常客户端的联邦学习任务。
本文研究了一种具有模型异构和数据污染客户端的挑战性鲁棒联邦学习任务,其中客户端具有不同的本地模型结构。由于实际部署中的随机噪声、压缩伪影或环境因素,数据污染不可避免,会严重破坏整个联邦系统。为此,本文提出一种新型鲁棒非对称异构联邦学习(RAHFL)框架。我们引入增强多样性有监督对比学习技术,利用混合数据增强策略生成复杂样本进行训练,提升模型在多种数据污染模式下的鲁棒性与适应性。此外,设计非对称异构联邦学习策略,在协作学习阶段允许客户端选择性地单向学习,避免引入低质量或表现较差的合作者信息。大量实验结果表明,该方法在多样且具挑战性的联邦学习环境中表现出优异的有效性和鲁棒性。代码与模型已公开于 https://github.com/FangXiuwen/RAHFL。
原文摘要 · Abstract (English)
This paper studies a challenging robust federated learning task with model heterogeneous and data corrupted clients, where the clients have different local model structures. Data corruption is unavoidable due to factors such as random noise, compression artifacts, or environmental conditions in real-world deployment, drastically crippling the entire federated system. To address these issues, this paper introduces a novel Robust Asymmetric Heterogeneous Federated Learning (RAHFL) framework. We propose a Diversity-enhanced supervised Contrastive Learning technique to enhance the resilience and adaptability of local models on various data corruption patterns. Its basic idea is to utilize complex augmented samples obtained by the mixed-data augmentation strategy for supervised contrastive learning, thereby enhancing the ability of the model to learn robust and diverse feature representations. Furthermore, we design an Asymmetric Heterogeneous Federated Learning strategy to resist corrupt feedback from external clients. The strategy allows clients to perform selective one-way learning during collaborative learning phase, enabling clients to refrain from incorporating lower-quality information from less robust or underperforming collaborators. Extensive experimental results demonstrate the effectiveness and robustness of our approach in diverse, challenging federated learning environments. Our code and models are public available at https://github.com/FangXiuwen/RAHFL.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。