arXiv:2503.00323cs.LGcs.AI2025-03中稿 · the The Eighth Ann…

FLStore通过无服务器缓存降低联邦学习非训练任务的延迟与成本。

FLStore: Efficient Federated Learning Storage for non-training workloads

  • 用无服务器缓存统一数据与计算,按需缓存提升本地化执行效率。
  • 相比云存储方案,请求平均延迟降71%,成本降92.45%,峰值降99.7%和98.8%。
  • 兼容现有联邦学习框架,适合需高效处理元数据的系统部署者。

联邦学习(FL)是一种保护隐私的机器学习方法,可在多个客户端间进行模型训练而无需集中收集数据。由聚合服务器协调训练、聚合模型更新并存储各轮次的元数据。除了训练任务外,大量非训练工作负载如调度、个性化、聚类、调试和激励机制也依赖这些元数据。现有系统通常由聚合服务器处理非训练任务,并使用云服务存储数据,导致高延迟与高昂成本。因为非训练任务需要处理大量元数据,包括客户端更新的权重参数、超参数及多轮聚合结果。我们提出 FLStore,一种面向高效联邦学习非训练工作负载与存储的无服务器框架。该框架将数据与计算平面统一于无服务器缓存中,通过定制化缓存策略实现局部性感知执行,显著降低延迟与成本。评估显示,相较于基于云对象存储的聚合服务器,FLStore 将每请求平均延迟降低 71%,成本降低 92.45%,峰值分别达 99.7% 和 98.8%;相比基于内存的云缓存聚合服务器,平均延迟降低 64.6%,成本降低 98.83%,峰值分别为 98.8% 和 99.6%。FLStore 可无缝集成至现有联邦学习框架,仅需少量修改,且具备容错性与高度可扩展性。

原文摘要 · Abstract (English)

Federated Learning (FL) is an approach for privacy-preserving Machine Learning (ML), enabling model training across multiple clients without centralized data collection. With an aggregator server coordinating training, aggregating model updates, and storing metadata across rounds. In addition to training, a substantial part of FL systems are the non-training workloads such as scheduling, personalization, clustering, debugging, and incentivization. Most existing systems rely on the aggregator to handle non-training workloads and use cloud services for data storage. This results in high latency and increased costs as non-training workloads rely on large volumes of metadata, including weight parameters from client updates, hyperparameters, and aggregated updates across rounds, making the situation even worse. We propose FLStore, a serverless framework for efficient FL non-training workloads and storage. FLStore unifies the data and compute planes on a serverless cache, enabling locality-aware execution via tailored caching policies to reduce latency and costs. Per our evaluations, compared to cloud object store based aggregator server FLStore reduces per request average latency by 71% and costs by 92.45%, with peak improvements of 99.7% and 98.8%, respectively. Compared to an in-memory cloud cache based aggregator server, FLStore reduces average latency by 64.6% and costs by 98.83%, with peak improvements of 98.8% and 99.6%, respectively. FLStore integrates seamlessly with existing FL frameworks with minimal modifications, while also being fault-tolerant and highly scalable.

联邦学习无服务器缓存优化系统架构

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。