在保护隐私的前提下,让分散数据直接训练生成模型,提升样本质量和推理速度。
Federated Flow Matching
- 各设备本地训练流模型,通过最优传输耦合保持隐私
- 新方法使生成路径更直,推理更快,图像质量接近中心化训练
- 适合医疗、金融等数据分散且需保密的领域使用
当前数据分散在各类设备与机构中,受隐私、产权和法规限制难以集中。这推动了在不依赖中心聚合的情况下,直接从分布式数据中训练生成模型的需求。本文提出联邦流匹配(Federated Flow Matching, FFM)框架,在隐私约束下训练流匹配模型。首先提出FFM-vanilla,客户端独立使用源与目标耦合进行本地训练,虽保隐私但导致流路径弯曲,影响推理效率。随后设计FFM-LOT,采用局部最优传输耦合以改善客户端内流的直线性,但在异构数据下缺乏全局一致性。最后提出FFM-GOT,基于最优传输的半对偶形式,引入共享全局势函数协调跨客户端耦合。在合成数据与图像数据集上的实验表明,FFM实现了隐私保护下的训练,同时提升了流的直线性与生成样本质量,性能接近中心化基线。
原文摘要 · Abstract (English)
Data today is decentralized, generated and stored across devices and institutions where privacy, ownership, and regulation prevent centralization. This motivates the need to train generative models directly from distributed data locally without central aggregation. In this paper, we introduce Federated Flow Matching (FFM), a framework for training flow matching models under privacy constraints. Specifically, we first examine FFM-vanilla, where each client trains locally with independent source and target couplings, preserving privacy but yielding curved flows that slow inference. We then develop FFM-LOT, which employs local optimal transport couplings to improve straightness within each client but lacks global consistency under heterogeneous data. Finally, we propose FFM-GOT, a federated strategy based on the semi-dual formulation of optimal transport, where a shared global potential function coordinates couplings across clients. Experiments on synthetic and image datasets show that FFM enables privacy-preserving training while enhancing both the flow straightness and sample quality in federated settings, with performance comparable to the centralized baseline.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。