arXiv:2512.20610cs.CVcs.LG2025-12

FedPOD提升联邦学习效率,灵活应对数据分布不均问题。

FedPOD: the deployable units of training for federated learning

  • 将训练任务拆分为可动态扩展的部署单元,类比Kubernetes POD。
  • Dice分数达0.78(WT)、0.71(ET)、0.72(TC),性能媲美现有方法。
  • 无需依赖历史轮次信息,支持灵活扩容,适合医疗等多中心场景。

本文提出FedPOD,该方法在2024年联邦肿瘤分割挑战赛中排名第一,旨在优化多客户端联邦学习中的训练效率与通信开销。受FedPIDAvg启发,FedPOD引入基于轮次的任务设计以提升效率。尽管FedPIDAvg通过预测熵的损失减少量作为权重并结合微分项实现性能提升,且利用泊松分布建模数据分布、结合PID控制器降低通信成本,尤其在数据偏斜情况下表现良好,但其排除异常参与者会限制数据利用率,且依赖连续参与方以使用历史学习信息。本工作通过纳入被识别为异常的参与者,摆脱对历史轮次信息的依赖,并引入每轮独立计算验证损失的方法,解决上述问题。在该挑战中,FedPOD在平均Dice分数上达到WT: 0.78、ET: 0.71、TC: 0.72,投影收敛分数平均0.74,性能与FedPIDAvg相当。此外,FedPOD概念借鉴Kubernetes最小计算单元POD,支持类似自动伸缩的弹性扩展,使轮次级任务可灵活按需部署。本研究展示了通过提升效率、灵活性与性能,推动联邦学习实用化的潜力。

原文摘要 · Abstract (English)

This paper proposes FedPOD, which ranked first in the 2024 Federated Tumor Segmentation (FeTS) Challenge, for optimizing learning efficiency and communication cost in federated learning among multiple clients. Inspired by FedPIDAvg, we define a round-wise task for FedPOD to enhance training efficiency. FedPIDAvg achieved performance improvement by incorporating the training loss reduction for prediction entropy as weights using differential terms. Furthermore, by modeling data distribution with a Poisson distribution and using a PID controller, it reduced communication costs even in skewed data distribution. However, excluding participants classified as outliers based on the Poisson distribution can limit data utilization. Additionally, PID controller requires the same participants to be maintained throughout the federated learning process as it uses previous rounds' learning information in the current round. In our approach, FedPOD addresses these issues by including participants excluded as outliers, eliminating dependency on previous rounds' learning information, and applying a method for calculating validation loss at each round. In this challenge, FedPOD presents comparable performance to FedPIDAvg in metrics of Dice score, 0.78, 0.71 and 0.72 for WT, ET and TC in average, and projected convergence score, 0.74 in average. Furthermore, the concept of FedPOD draws inspiration from Kubernetes' smallest computing unit, POD, designed to be compatible with Kubernetes auto-scaling. Extending round-wise tasks of FedPOD to POD units allows flexible design by applying scale-out similar to Kubernetes' auto-scaling. This work demonstrated the potentials of FedPOD to enhance federated learning by improving efficiency, flexibility, and performance in metrics.

联邦学习医疗影像高效训练弹性扩展

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。