arXiv:2409.15802cs.DCcs.LG2024-09被引 1

解决工业4.0联邦学习中的类别不平衡问题,提升模型性能。

A Multi-Level Approach for Class Imbalance Problem in Federated Learning for Remote Industry 4.0 Applications

  • 本地使用适配损失函数缓解数据类别不平衡。
  • 动态阈值机制按权重筛选参与聚合的设备,提升模型鲁棒性。
  • 在远程油气田场景中实测,性能比基线提升3-5%。

深度神经网络(DNN)在工业4.0应用中表现优异,如油污检测、火灾检测和异常检测。然而,训练DNN需要大量来自多方的数据并上传至中心云服务器,成本高且存在隐私风险。在远程海上油田等网络不稳定的场景下,联邦雾计算平台可作为可行的计算方案。但雾系统中的联邦学习(FL)面临本地数据集固有的类别不平衡问题,会降低全局模型性能。为此,本文在本地层面采用适合的损失函数缓解类别不平衡,在全局层面引入带用户定义权重的动态阈值机制,高效筛选参与聚合的客户端,增强全局模型鲁棒性。通过大规模实验验证,所提方法相比基线联邦学习在性能上提升达3%-5%。

原文摘要 · Abstract (English)

Deep neural network (DNN) models are effective solutions for industry 4.0 applications (\eg oil spill detection, fire detection, anomaly detection). However, training a DNN network model needs a considerable amount of data collected from various sources and transferred to the central cloud server that can be expensive and sensitive to privacy. For instance, in the remote offshore oil field where network connectivity is vulnerable, a federated fog environment can be a potential computing platform. Hence it is feasible to perform computation within the federation. On the contrary, performing a DNN model training using fog systems poses a security issue that the federated learning (FL) technique can resolve. In this case, the new challenge is the class imbalance problem that can be inherited in local data sets and can degrade the performance of the global model. Therefore, FL training needs to be performed considering the class imbalance problem locally. In addition, an efficient technique to select the relevant worker model needs to be adopted at the global level to increase the robustness of the global model. Accordingly, we utilize one of the suitable loss functions addressing the class imbalance in workers at the local level. In addition, we employ a dynamic threshold mechanism with user-defined worker's weight to efficiently select workers for aggregation that improve the global model's robustness. Finally, we perform an extensive empirical evaluation to explore the benefits of our solution and find up to 3-5% performance improvement than baseline federated learning methods.

联邦学习类别不平衡工业4.0雾计算

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。