用原型和轻量适配器提升联邦学习的可解释性与泛化能力
Prototype-Guided and Lightweight Adapters for Inherent Interpretation and Generalisation in Federated Learning
- 通过原型对齐实现模型局部更新的可解释性
- 轻量适配器替代完整模型参数传输,降低通信开销
- 在真实眼底图像数据上验证了精度提升与可解释性
联邦学习(FL)在保护隐私的前提下协同训练分布式数据上的模型,但面临通信开销大和统计异质性问题,即客户端数据分布不一致。本文提出一种新框架:1)利用原型提供内在可解释性;2)通过轻量适配器作为本地模型的压缩代理,缓解分布差异带来的泛化挑战。每个客户端通过将类别嵌入对齐到原型表示,并同步调整轻量适配器,实现局部优化。该方法以原型和适配器代替完整模型参数传输,使各客户端模型与全局结构对齐,同时显著降低通信负担并支持可解释性分析。实验基于含临床站点信息的真实眼底视网膜图像数据集,完成分类任务,结果表明该方法在准确率上优于基线算法。
原文摘要 · Abstract (English)
Federated learning (FL) provides a promising paradigm for collaboratively training machine learning models across distributed data sources while maintaining privacy. Nevertheless, real-world FL often faces major challenges including communication overhead during the transfer of large model parameters and statistical heterogeneity, arising from non-identical independent data distributions across clients. In this work, we propose an FL framework that 1) provides inherent interpretations using prototypes, and 2) tackles statistical heterogeneity by utilising lightweight adapter modules to act as compressed surrogates of local models and guide clients to achieve generalisation despite varying client distribution. Each client locally refines its model by aligning class embeddings toward prototype representations and simultaneously adjust the lightweight adapter. Our approach replaces the need to communicate entire model weights with prototypes and lightweight adapters. This design ensures that each client's model aligns with a globally shared structure while minimising communication load and providing inherent interpretations. Moreover, we conducted our experiments on a real-world retinal fundus image dataset, which provides clinical-site information. We demonstrate inherent interpretable capabilities and perform a classification task, which shows improvements in accuracy over baseline algorithms.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。