arXiv:2505.16857cs.LG2025-05被引 1

无需先验知识,动态聚类实现高效系统辨识联邦学习

Redefining Clustered Federated Learning for System Identification: The Path of ClusterCraft

  • 用增量聚类方法自动分组数据源,避免依赖预设集群数
  • 实验表明在车辆动力学建模中性能优越且集群稳定
  • 适合大规模分布式系统辨识,尤其无标签数据场景

本文在联邦学习框架下解决系统辨识(SYSID)问题。提出一种新型算法IC-SYSID,可在无先验知识条件下处理多源数据的SYSID挑战。该算法采用增量聚类方法ClusterCraft(CC),从单一簇模型开始,通过动态增加簇数将相似本地节点归入同一簇。为减少簇数量,引入簇合并机制ClusterMerge,合并相似簇模型;同时改进ClusterCraft以降低训练中生成重复模型。为应对簇模型不稳定性,将正则化项加入损失函数,并采用缩放的Glorot初始化;还采用小批量深度学习方法管理大规模本地训练数据。在真实车辆动力学建模场景下进行实验,验证了IC-SYSID在保持高辨识性能的同时有效防止不稳定簇的产生。

原文摘要 · Abstract (English)

This paper addresses the System Identification (SYSID) problem within the framework of federated learning. We introduce a novel algorithm, Incremental Clustering-based federated learning method for SYSID (IC-SYSID), designed to tackle SYSID challenges across multiple data sources without prior knowledge. IC-SYSID utilizes an incremental clustering method, ClusterCraft (CC), to eliminate the dependency on the prior knowledge of the dataset. CC starts with a single cluster model and assigns similar local workers to the same clusters by dynamically increasing the number of clusters. To reduce the number of clusters generated by CC, we introduce ClusterMerge, where similar cluster models are merged. We also introduce enhanced ClusterCraft to reduce the generation of similar cluster models during the training. Moreover, IC-SYSID addresses cluster model instability by integrating a regularization term into the loss function and initializing cluster models with scaled Glorot initialization. It also utilizes a mini-batch deep learning approach to manage large SYSID datasets during local training. Through the experiments conducted on a real-world representing SYSID problem, where a fleet of vehicles collaboratively learns vehicle dynamics, we show that IC-SYSID achieves a high SYSID performance while preventing the learning of unstable clusters.

系统辨识联邦学习聚类车辆建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。