arXiv:2412.18557cs.LG2024-12中稿 · AAAI被引 18

通过压缩有价值知识,实现医疗影像联邦学习的高效与抗非独立同分布。

FedVCK: Non-IID Robust and Communication-Efficient Federated Learning via Valuable Condensed Knowledge for Medical Image Analysis

  • 客户端压缩知识并加潜分布约束,提升知识质量
  • 只传递未被模型吸收的知识,减少通信频率
  • 适合数据异构的医疗场景,兼顾性能与隐私

联邦学习为医疗机构协作提供了新路径,但各机构数据高度异质,分布呈非独立同分布(non-IID),导致客户端漂移和性能下降。现有方法虽尝试解决非IID问题,却仍依赖频繁通信,带来高成本与隐私风险。本文提出新型联邦学习方法:基于有价值压缩知识的联邦学习(FedVCK)。客户端将知识压缩为小规模数据集,并引入潜分布约束以增强压缩效果,有效捕捉高质量知识;每轮仅针对当前模型尚未吸收的知识进行聚焦压缩,避免重复传输同质信息,降低通信频次。服务端采用关系监督对比学习,提供更强监督信号辅助全局模型更新。在多个医学任务上的实验证明,FedVCK优于现有先进方法,具备非IID鲁棒性与通信高效性。

原文摘要 · Abstract (English)

Federated learning has become a promising solution for collaboration among medical institutions. However, data owned by each institution would be highly heterogeneous and the distribution is always non-independent and identical distribution (non-IID), resulting in client drift and unsatisfactory performance. Despite existing federated learning methods attempting to solve the non-IID problems, they still show marginal advantages but rely on frequent communication which would incur high costs and privacy concerns. In this paper, we propose a novel federated learning method: \textbf{Fed}erated learning via \textbf{V}aluable \textbf{C}ondensed \textbf{K}nowledge (FedVCK). We enhance the quality of condensed knowledge and select the most necessary knowledge guided by models, to tackle the non-IID problem within limited communication budgets effectively. Specifically, on the client side, we condense the knowledge of each client into a small dataset and further enhance the condensation procedure with latent distribution constraints, facilitating the effective capture of high-quality knowledge. During each round, we specifically target and condense knowledge that has not been assimilated by the current model, thereby preventing unnecessary repetition of homogeneous knowledge and minimizing the frequency of communications required. On the server side, we propose relational supervised contrastive learning to provide more supervision signals to aid the global model updating. Comprehensive experiments across various medical tasks show that FedVCK can outperform state-of-the-art methods, demonstrating that it's non-IID robust and communication-efficient.

联邦学习医疗影像知识压缩非IID

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。