针对物联网设备数据异构,提出客户端自适应联邦学习方法
FedCCA: Client-Centric Adaptation against Data Heterogeneity in Federated Learning on IoT Devices
- 按客户端特征动态选参,用专用编码器提取个性化知识
- 注意力机制聚合全局模型,提升多源知识迁移效率
- 在多个数据集上显著优于基线,适合边缘智能场景
随着物联网(IoT)快速发展,对私有数据如人体感知数据进行AI模型训练的需求日益增长。联邦学习(FL)作为一种隐私保护的分布式训练框架应运而生。然而,物联网设备间的数据异构性会严重降低模型性能与收敛速度。现有方法受限于固定的客户端选择和云端聚合策略,难以在本地训练中有效提取客户端特异性信息。为此,我们提出客户端自适应联邦学习(FedCCA),通过选择性适应,为每个客户端学习独特模型,以缓解数据异构的影响。具体地,FedCCA采用基于额外客户端特异性编码器的动态客户端选择与自适应聚合。为增强多源知识迁移,引入基于注意力的全局聚合策略。我们在多种数据集上进行了广泛实验,结果表明,该方法在解决此问题上相比竞争基线展现出显著性能优势。
原文摘要 · Abstract (English)
With the rapid development of the Internet of Things (IoT), AI model training on private data such as human sensing data is highly desired. Federated learning (FL) has emerged as a privacy-preserving distributed training framework for this purpuse. However, the data heterogeneity issue among IoT devices can significantly degrade the model performance and convergence speed in FL. Existing approaches limit in fixed client selection and aggregation on cloud server, making the privacy-preserving extraction of client-specific information during local training challenging. To this end, we propose Client-Centric Adaptation federated learning (FedCCA), an algorithm that optimally utilizes client-specific knowledge to learn a unique model for each client through selective adaptation, aiming to alleviate the influence of data heterogeneity. Specifically, FedCCA employs dynamic client selection and adaptive aggregation based on the additional client-specific encoder. To enhance multi-source knowledge transfer, we adopt an attention-based global aggregation strategy. We conducted extensive experiments on diverse datasets to assess the efficacy of FedCCA. The experimental results demonstrate that our approach exhibits a substantial performance advantage over competing baselines in addressing this specific problem.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。