arXiv:2503.12137cs.LGcs.SY2025-03被引 1

解决联邦系统辨识中状态表示不一致问题,提升全局模型稳定性与收敛速度。

A State Alignment-Centric Approach to Federated System Identification: The FedAlign Framework

  • 通过相似变换矩阵对齐本地状态空间模型的状态表示,建立共享参数基底。
  • 在合成与真实数据集上,相比FedAvg收敛更快且全局模型更稳定。
  • 适用于多输入多输出系统辨识,适合需高精度动态建模的工业场景。

本文提出FedAlign,一种专为系统辨识(SYSID)任务设计的联邦学习框架,通过对齐状态表示来解决局部模型动态失真问题。在联邦学习中,各客户端可学习具有等效表示但不同动态特性的状态空间模型(SSMs)。直接使用FedAvg聚合这些本地模型会导致全局模型的系统动态发生改变。FedAlign通过引入相似变换矩阵,将本地SSM的状态表示对齐至同一参考基底,从而保留各本地模型的原始动态特性。该方法采用两种实现方式:在FedAlign-A中,将全局SSM设为可控制标准型(CCF),利用控制理论解析推导转换矩阵;在多输入多输出系统中,因CCF非唯一性带来新挑战,故引入FedAlign-O,将其转化为优化问题,以最小二乘法求解相似变换矩阵,使所有本地模型对齐至共同参数基底。实验在合成及真实数据集上验证了其有效性,结果表明FedAlign优于FedAvg,在收敛速度和全局模型稳定性方面均有显著提升。

原文摘要 · Abstract (English)

This paper presents FedAlign, a Federated Learning (FL) framework particularly designed for System Identification (SYSID) tasks by aligning state representations. Local workers can learn State-Space Models (SSMs) with equivalent representations but different dynamics. We demonstrate that directly aggregating these local SSMs via FedAvg results in a global model with altered system dynamics. FedAlign overcomes this problem by employing similarity transformation matrices to align state representations of local SSMs, thereby establishing a common parameter basin that retains the dynamics of local SSMs. FedAlign computes similarity transformation matrices via two distinct approaches: FedAlign-A and FedAlign-O. In FedAlign-A, we represent the global SSM in controllable canonical form (CCF). We apply control theory to analytically derive similarity transformation matrices that convert each local SSM into this form. Yet, establishing global SSM in CCF brings additional alignment challenges in multi input - multi output SYSID as CCF representation is not unique, unlike in single input - single output SYSID. In FedAlign-O, we address these alignment challenges by reformulating the local parameter basin alignment problem as an optimization task. We determine the parameter basin of a local worker as the common parameter basin and solve least square problems to obtain similarity transformation matrices needed to align the remaining local SSMs. Through the experiments conducted on synthetic and real-world datasets, we show that FedAlign outperforms FedAvg, converges faster, and provides improved stability of the global SSM thanks to the efficient alignment of local parameter basins.

联邦学习系统辨识状态空间模型参数对齐

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。