提出异步联邦持续分割框架,支持客户端和标签空间动态演化。
Asynchronous Federated Continual Segmentation with Evolving Clients and Label Spaces
- 用多模型蒸馏机制维护客户端模型档案,避免重复聚合
- 新客户端加入仅上传更新模型,旧客户端可离线贡献知识
- 在3D腹部CT分割任务中实现高效知识融合与良好性能
联邦学习旨在促进分布式客户端协作的同时保护本地数据隐私。传统方法通常假设客户端、数据及学习目标保持不变,但在实际场景中,联邦系统可能随时间演变,包括客户端组成和目标标签空间的变化。在此演化环境中,传统的轮次式模型聚合变得僵化,每次更新需重复通信、重复本地计算,并要求所有累积客户端同步参与。为解决此问题,我们提出CA-MMDS,一种面向异步客户端与动态标签空间的联邦持续分割持续多模型蒸馏框架。该框架不重复聚合所有客户端参数,而是维护服务器端的客户端模型档案,并通过多个归档本地模型的代理蒸馏来更新全局模型。当新客户端加入或现有客户端演化时,仅需上传新增或更新的本地模型,未变化的客户端可保持离线,并通过其归档模型继续贡献知识。这一设计显著降低通信与计算开销,同时实现灵活的异步协作。以多类3D腹部CT分割为应用任务,实验表明CA-MMDS能高效融合演化中的客户端知识,并达到具有竞争力的分割性能。
原文摘要 · Abstract (English)
Federated learning seeks to foster collaboration among distributed clients while preserving the privacy of their local data. Traditional federated learning methods typically assume a fixed setting, where participating clients, client data, and learning objectives remain unchanged. However, in real-world scenarios, a federation may evolve over time, with changes in both its client composition and target label space. In this evolving federated setting, conventional round-wise model aggregation becomes inflexible, as each federation update requires repeated communication, repeated local computation, and synchronized participation from all accumulated clients. To address this limitation, we propose CA-MMDS, a continual multiple-model distillation framework for federated continual segmentation with asynchronous clients and evolving label spaces. Instead of repeatedly aggregating model parameters from all clients, CA-MMDS maintains a server-side archive of client models and updates the global model through proxy-based distillation from multiple archived local models. When new clients join or existing clients evolve, only the newly added or updated local models need to be uploaded, while unchanged clients can remain offline and continue to contribute through their archived models. This design substantially reduces communication and computation costs while enabling flexible asynchronous cooperation among evolving clients. Using multi-class 3D abdominal CT segmentation as an application task, we demonstrate that CA-MMDS efficiently incorporates evolving client knowledge while achieving competitive segmentation performance.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。