用伪标签与对比学习,让少标注的设备故障诊断更准更私密。
Semi-Supervised Federated Learning via Dual Contrastive Learning and Soft Labeling for Intelligent Fault Diagnosis
- 客户端用未标注数据学特征,通过双对比损失稳定模型。
- 仅10%标签时准确率提升1.15%至7.85%,优于现有方法。
- 适合工业场景中数据少、标签贵、隐私要求高的故障诊断。
智能故障诊断(IFD)对保障工业设备安全运行和提升生产效率至关重要。然而,传统监督深度学习需大量带标签数据,且常分布于不同客户端,标注成本高,难以获取。同时,客户端间数据分布差异也影响模型性能。为此,本文提出半监督联邦学习框架SSFL-DCSL,融合双对比损失与软标签机制,在分布式客户端仅少量标注样本条件下,缓解数据与标签稀缺问题,同时保护用户隐私。该框架在客户端利用未标注数据进行表征学习,并通过原型聚合实现客户端间知识共享,防止局部模型漂移。具体而言:首先设计基于拉普拉斯分布的样本加权函数,缓解伪标签置信度低带来的偏差;其次引入包含局部与全局对比损失的双对比损失,降低因数据分布差异导致的模型发散;最后在服务器端以加权平均和动量更新方式聚合本地原型,促进知识传递。在两个公开数据集及工厂采集的电机数据集上进行实验,最严苛任务下(仅10%数据标注)相较最优方法准确率提升1.15%至7.85%。
原文摘要 · Abstract (English)
Intelligent fault diagnosis (IFD) plays a crucial role in ensuring the safe operation of industrial machinery and improving production efficiency. However, traditional supervised deep learning methods require a large amount of training data and labels, which are often located in different clients. Additionally, the cost of data labeling is high, making labels difficult to acquire. Meanwhile, differences in data distribution among clients may also hinder the model's performance. To tackle these challenges, this paper proposes a semi-supervised federated learning framework, SSFL-DCSL, which integrates dual contrastive loss and soft labeling to address data and label scarcity for distributed clients with few labeled samples while safeguarding user privacy. It enables representation learning using unlabeled data on the client side and facilitates joint learning among clients through prototypes, thereby achieving mutual knowledge sharing and preventing local model divergence. Specifically, first, a sample weighting function based on the Laplace distribution is designed to alleviate bias caused by low confidence in pseudo labels during the semi-supervised training process. Second, a dual contrastive loss is introduced to mitigate model divergence caused by different data distributions, comprising local contrastive loss and global contrastive loss. Third, local prototypes are aggregated on the server with weighted averaging and updated with momentum to share knowledge among clients. To evaluate the proposed SSFL-DCSL framework, experiments are conducted on two publicly available datasets and a dataset collected on motors from the factory. In the most challenging task, where only 10\% of the data are labeled, the proposed SSFL-DCSL can improve accuracy by 1.15% to 7.85% over state-of-the-art methods.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。