解决工业质检中数据异构下的模型性能下降问题
Adversarial Federated Consensus Learning for Surface Defect Classification Under Data Heterogeneity in IIoT
- 通过对抗训练实现本地模型与全局模型的分布对齐
- 在三个数据集上准确率提升最高达5.67%
- 适合面临数据异构的工业视觉缺陷检测场景
工业互联网中表面缺陷分类(SDC)因数据稀缺难以应用深度学习,由于隐私顾虑,难以从不同实体集中收集和整合足够训练数据。联邦学习(FL)可在保护隐私的前提下实现跨客户端协同训练。然而,客户端间数据分布差异导致性能下降。本文提出一种新型个性化联邦学习方法——对抗联邦共识学习(AFedCL),以应对数据异构问题。首先,设计动态共识构建策略,通过对抗训练使各客户端本地模型利用全局模型作为桥梁实现分布对齐,缓解全局知识遗忘。其次,提出共识感知聚合机制,根据客户端在全局知识学习中的有效性分配聚合权重,提升全局模型泛化能力。最后,设计自适应特征融合模块,为每个客户端动态调整融合权重,优化全局与局部特征平衡。相比FedALA等先进方法,AFedCL在三个SDC数据集上准确率最高提升5.67%。
原文摘要 · Abstract (English)
The challenge of data scarcity hinders the application of deep learning in industrial surface defect classification (SDC), as it's difficult to collect and centralize sufficient training data from various entities in Industrial Internet of Things (IIoT) due to privacy concerns. Federated learning (FL) provides a solution by enabling collaborative global model training across clients while maintaining privacy. However, performance may suffer due to data heterogeneity-discrepancies in data distributions among clients. In this paper, we propose a novel personalized FL (PFL) approach, named Adversarial Federated Consensus Learning (AFedCL), for the challenge of data heterogeneity across different clients in SDC. First, we develop a dynamic consensus construction strategy to mitigate the performance degradation caused by data heterogeneity. Through adversarial training, local models from different clients utilize the global model as a bridge to achieve distribution alignment, alleviating the problem of global knowledge forgetting. Complementing this strategy, we propose a consensus-aware aggregation mechanism. It assigns aggregation weights to different clients based on their efficacy in global knowledge learning, thereby enhancing the global model's generalization capabilities. Finally, we design an adaptive feature fusion module to further enhance global knowledge utilization efficiency. Personalized fusion weights are gradually adjusted for each client to optimally balance global and local features. Compared with state-of-the-art FL methods like FedALA, the proposed AFedCL method achieves an accuracy increase of up to 5.67% on three SDC datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。