在不共享原始数据下,用图注意力模型解析工业系统间非线性时序依赖关系。
Federated Learning of Nonlinear Temporal Dynamics with Graph Attention-based Cross-Client Interpretability
- 各客户端用非线性状态空间模型压缩数据,服务器用图注意力网络建模跨客户端状态转移。
- 通过雅可比矩阵与注意力系数关联,首次实现对跨客户端时序依赖的可解释性分析。
- 适用于隐私敏感场景,尤其适合工业系统中无法修改本地模型的部署需求。
现代工业系统的分布式传感器网络产生高维时序数据,各子系统间存在相互依赖关系,理解其时序模式关联至关重要。但在去中心化环境中,原始数据不可共享,且各客户端使用固定私有模型,难以调整或重训练。非线性动态进一步使跨客户端时序依赖难以解析,因其嵌入于非线性状态转移函数中。本文提出一种联邦学习框架,在上述约束下学习跨客户端的时序依赖关系:每个客户端使用非线性状态空间模型将高维观测映射为低维潜在状态;中央服务器基于通信的潜在状态,利用图注意力网络学习结构化神经状态转移模型。为实现可解释性,将服务器端转移模型的雅可比矩阵与注意力系数关联,首次提供去中心化非线性系统中跨客户端时序依赖的可解释表征。理论证明该方法收敛至集中式基准,并通过合成实验验证了收敛性、可解释性、可扩展性与隐私保护能力;真实世界实验表明性能优于或相当于是去中心化基线。
原文摘要 · Abstract (English)
Networks of modern industrial systems are increasingly monitored by distributed sensors, where each system comprises multiple subsystems generating high dimensional time series data. These subsystems are often interdependent, making it important to understand how temporal patterns at one subsystem relate to others. This is challenging in decentralized settings where raw measurements cannot be shared and client observations are heterogeneous. In practical deployments each subsystem (client) operates a fixed proprietary model that cannot be modified or retrained, limiting existing approaches. Nonlinear dynamics further make cross client temporal interdependencies difficult to interpret because they are embedded in nonlinear state transition functions. We present a federated framework for learning temporal interdependencies across clients under these constraints. Each client maps high dimensional local observations to low dimensional latent states using a nonlinear state space model. A central server learns a graph structured neural state transition model over the communicated latent states using a Graph Attention Network. For interpretability we relate the Jacobian of the learned server side transition model to attention coefficients, providing the first interpretable characterization of cross client temporal interdependencies in decentralized nonlinear systems. We establish theoretical convergence guarantees to a centralized oracle and validate the framework through synthetic experiments demonstrating convergence, interpretability, scalability and privacy. Additional real world experiments show performance comparable to decentralized baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。