arXiv:2508.11794cs.LG2025-08被引 3

针对异构物联网设备,提出分阶段聚合与个性化框架,提升小模型推理准确率。

Fed-Meta-Align: A Similarity-Aware Aggregation and Personalization Pipeline for Federated TinyML on Heterogeneous Data

  • 先用公共数据预训练,再通过元初始化学习设备差异特征。
  • 融合性能与相似度双重指标,动态加权聚合各设备更新。
  • 支持边缘设备个性化适配,适合工业故障实时检测场景。

资源受限的物联网设备实现实时故障分类对工业安全至关重要,但异构数据环境下训练鲁棒模型仍是难题。标准联邦学习在非独立同分布(non-IID)数据下常导致模型发散。本文提出Fed-Meta-Align,一种四阶段框架:首先在通用公开数据集上训练基础模型;接着通过序列化元初始化,在部分物联网设备数据上逐步学习具备异构感知能力的初始状态;随后在并行联邦学习阶段,采用基于本地性能与余弦相似度双准则的聚合机制;最后在设备端进行个性化微调,生成专用专家模型。实验表明,该方法在异构物联网设备上平均测试准确率达91.27%,在电气与机械故障数据集上分别优于个性化FedAvg和FedProx达3.87%和3.37%。该多阶段序列初始化与自适应聚合策略为多样化小型机器学习网络部署高性能智能提供了可靠路径。

原文摘要 · Abstract (English)

Real-time fault classification in resource-constrained Internet of Things (IoT) devices is critical for industrial safety, yet training robust models in such heterogeneous environments remains a significant challenge. Standard Federated Learning (FL) often fails in the presence of non-IID data, leading to model divergence. This paper introduces Fed-Meta-Align, a novel four-phase framework designed to overcome these limitations through a sophisticated initialization and training pipeline. Our process begins by training a foundational model on a general public dataset to establish a competent starting point. This model then undergoes a serial meta-initialization phase, where it sequentially trains on a subset of IOT Device data to learn a heterogeneity-aware initialization that is already situated in a favorable region of the loss landscape. This informed model is subsequently refined in a parallel FL phase, which utilizes a dual-criterion aggregation mechanism that weights for IOT devices updates based on both local performance and cosine similarity alignment. Finally, an on-device personalization phase adapts the converged global model into a specialized expert for each IOT Device. Comprehensive experiments demonstrate that Fed-Meta-Align achieves an average test accuracy of 91.27% across heterogeneous IOT devices, outperforming personalized FedAvg and FedProx by up to 3.87% and 3.37% on electrical and mechanical fault datasets, respectively. This multi-stage approach of sequenced initialization and adaptive aggregation provides a robust pathway for deploying high-performance intelligence on diverse TinyML networks.

联邦学习边缘计算小模型故障检测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。