arXiv:2507.12979cs.LGcs.AI2025-07中稿 · and published in T…被引 1

在不共享数据的前提下,用分散设备训练生成模型,提升跨领域性能。

A Distributed Generative AI Approach for Heterogeneous Multi-Domain Environments under Data Sharing constraints

  • 结合聚类联邦与分层分割学习,应对数据和设备异构性。
  • 多域非独立同分布下分类准确率提升最高达60%,图像生成质量显著改善。
  • 适合资源受限、隐私要求高的物联网或边缘计算场景使用。

联邦学习使多个节点可在不共享原始数据的情况下协作训练模型。生成式AI(如生成对抗网络GAN)在医疗、安防和图像生成等领域取得显著成果。然而,训练生成模型通常需要大量数据和强大算力,而现实中许多低性能设备(如物联网和边缘设备)闲置未用,且因隐私与版权问题难以获取大规模数据。为此,我们提出一种去中心化GAN训练新方法,利用分布式数据和低能力设备,在不共享标签或原始数据(包括真实与合成数据)的前提下实现高效训练。该方法融合基于KL散度加权的聚类联邦学习以应对数据异构与多领域挑战,采用异构U型分割学习解决设备异构下的严格数据共享限制。实验表明,本方法在关键指标上均有显著提升:分类性能平均提高10%(多域非独立同分布下最高达60%),对MNIST系列数据集图像生成得分提升1.1至3倍,高分辨率数据集的FID分数降低2至70倍。代码已公开于https://distributed-gen-ai.github.io/huscf-gan.github.io/。

原文摘要 · Abstract (English)

Federated Learning has gained attention for its ability to enable multiple nodes to collaboratively train machine learning models without sharing raw data. At the same time, Generative AI -- particularly Generative Adversarial Networks (GANs) -- have achieved remarkable success across a wide range of domains, such as healthcare, security, and Image Generation. However, training generative models typically requires large datasets and significant computational resources, which are often unavailable in real-world settings. Acquiring such resources can be costly and inefficient, especially when many underutilized devices -- such as IoT devices and edge devices -- with varying capabilities remain idle. Moreover, obtaining large datasets is challenging due to privacy concerns and copyright restrictions, as most devices are unwilling to share their data. To address these challenges, we propose a novel approach for decentralized GAN training that enables utilizing distributed data and underutilized, low-capability devices while not sharing data in its raw form. Our approach is designed to tackle key challenges in decentralized environments, combining KLD-weighted Clustered Federated Learning to address the issues of data heterogeneity and multi-domain datasets, with Heterogeneous U-Shaped split learning to tackle the challenge of device heterogeneity under strict data sharing constraints -- ensuring that no labels or raw data, whether real or synthetic, are ever shared between nodes. Experiments show that our approach demonstrates significant improvements across key metrics, where it achieves an average 10% boost in classification metrics (up to 60% in multi-domain non-IID settings), 1.1x -- 3x higher image generation scores for the MNIST family datasets, and 2x -- 70x lower FID scores for higher resolution datasets. Find our code at https://distributed-gen-ai.github.io/huscf-gan.github.io/.

生成模型联邦学习边缘计算数据隐私

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。