arXiv:2409.06904cs.LGcs.AI2024-09被引 1

提出融合个性化技术的联邦学习系统,提升工业物联网实时模型精度。

Applied Federated Model Personalisation in the Industrial Domain: A Comparative Study

  • 结合主动学习、知识蒸馏与本地记忆,实现轻量化模型个性化
  • 在本地与联邦场景下均显著提升模型准确率,实测效果优于基线
  • 适合需低延迟、高定制化的工业智能终端应用

复杂机器学习与深度学习模型在多种应用场景中的训练和部署耗时问题持续带来挑战,尤其在联邦学习领域,针对单个节点的模型优化尤为困难。为应对这一问题,研究提出一种先进联邦学习系统,集成主动学习、知识蒸馏与本地记忆三种个性化策略,以降低训练开销并提升模型效率。该方法支持轻量级模型部署,利用本地数据增强个性化能力,从而提升真实场景下的NG-IoT应用性能。通过对比原始模型与优化后模型在本地与联邦环境下的表现,验证了所提技术的有效性,结果表明个性化策略在提升模型准确率与用户体验方面具有显著优势。

原文摘要 · Abstract (English)

The time-consuming nature of training and deploying complicated Machine and Deep Learning (DL) models for a variety of applications continues to pose significant challenges in the field of Machine Learning (ML). These challenges are particularly pronounced in the federated domain, where optimizing models for individual nodes poses significant difficulty. Many methods have been developed to tackle this problem, aiming to reduce training expenses and time while maintaining efficient optimisation. Three suggested strategies to tackle this challenge include Active Learning, Knowledge Distillation, and Local Memorization. These methods enable the adoption of smaller models that require fewer computational resources and allow for model personalization with local insights, thereby improving the effectiveness of current models. The present study delves into the fundamental principles of these three approaches and proposes an advanced Federated Learning System that utilises different Personalisation methods towards improving the accuracy of AI models and enhancing user experience in real-time NG-IoT applications, investigating the efficacy of these techniques in the local and federated domain. The results of the original and optimised models are then compared in both local and federated contexts using a comparison analysis. The post-analysis shows encouraging outcomes when it comes to optimising and personalising the models with the suggested techniques.

联邦学习模型个性化工业物联网

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。