对比三种生成模型在联邦预测维护中的权衡,发现部分共享解码器可提升带宽受限场景性能。
On the Tradeoffs of On-Device Generative Models in Federated Predictive Maintenance Systems

- 提出部分组件共享的联邦生成模型新分类法,支持个性化建模。
- 在非独立同分布数据下,扩散模型部分共享解码器优于全量共享。
- 实测显示生成模型在资源受限工业场景中存在性能与通信的显著权衡。
联邦学习(FL)为分布式物联网环境中的客户端数据主权保护提供了新范式。尽管判别模型主导多数联邦应用,近年来变分自编码器(VAE)、生成对抗网络(GAN)和扩散模型(DM)等生成模型在时间序列无监督异常检测方面展现出潜力,适用于关键工业基础设施的预测性维护(PdM)。本文全面分析了这三类生成模型在联邦PdM中的表现与通信开销,涵盖全联邦与部分联邦两种设置(仅共享部分模型组件)。基于此,论文提出一种新型联邦生成模型分类法,将部分组件共享形式化为模型个性化的原则性机制。在真实世界时间序列数据集上的实验揭示了模型效用、稳定性与可扩展性之间的显著权衡,尤其在异构且带宽受限的联邦设置中。对于评估的基于GAN的配置,全联邦训练相比本地独立训练提升了稳定性,但整体仍不如VAE与DDPM方案稳健。而对于扩散模型,部分联邦(特别是解码器共享)在带宽受限、非独立同分布条件下反而优于全联邦。
原文摘要 · Abstract (English)
Federated Learning (FL) has emerged as a promising paradigm for preserving client data ownership and control over distributed Internet of Things (IoT) environments. While discriminative models dominate most FL use cases, recent advances in generative models -- such as Variational Autoencoders (VAE), Generative Adversarial Networks (GAN), and Diffusion Models (DM) -- offer new opportunities for unsupervised anomaly detection in time series analysis, with relevant applications in predictive maintenance (PdM) in critical industrial infrastructures. In this work, we present a comprehensive analysis of VAEs, GANs, and DMs in the context of federated PdM. We analyze their performance and communication overhead under both full and partial federation setups, where only subsets of model components are shared. Building on this analysis, the paper proposes a novel taxonomy for federated generative models that formalizes partial component sharing as a principled mechanism for model personalization. Our experiments over a real-world time series dataset reveal distinct trade-offs in model utility, stability, and scalability, especially in heterogeneous and bandwidth-constrained FL settings. For the evaluated GAN-based configurations, full federation improves training stability relative to independent local training, although the model remains less robust than the VAE- and DDPM-based alternatives. For DMs, however, partial federation -- especially decoder sharing -- can outperform full federation in bandwidth-constrained, non-IID settings.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。