arXiv:2509.19220cs.LGcs.AI2025-09

FedFusion通过自适应编码器提升标签稀缺下的联邦学习鲁棒性

FedFusion: Federated Learning with Diversity- and Cluster-Aware Encoders for Robust Adaptation under Label Scarcity

  • 设计多样性和聚类感知编码器,实现个性化与全局协同平衡
  • 在标签稀缺场景下仍保持高准确率,少数客户端性能提升显著
  • 适合数据异构、标注成本高的实际联邦学习应用

实际联邦学习面临特征空间异质、数据严重非独立同分布及客户端标签稀缺等问题。我们提出FedFusion,一种统一领域自适应与轻量标注的联邦迁移学习框架。通过置信度过滤的伪标签和域自适应传输,有标签教师客户端指导无标签学习客户端;各客户端保留针对本地数据的个性化编码器。为在异质环境下保持全局一致性,采用相似性加权分类器耦合(可选聚类平均),缓解数据丰富站点的主导影响,提升少数客户端表现。轻量标注流程结合自/半监督预训练与选择性微调,降低标注需求且不共享原始数据。在表格与图像基准上,无论在IID、非IID或标签稀缺条件下,FedFusion均持续优于现有最先进基线,在准确率、鲁棒性与公平性方面表现更优,同时通信与计算开销相当。结果表明,在真实约束下,协调个性化、域自适应与标签效率是实现稳健联邦学习的有效策略。

原文摘要 · Abstract (English)

Federated learning in practice must contend with heterogeneous feature spaces, severe non-IID data, and scarce labels across clients. We present FedFusion, a federated transfer-learning framework that unifies domain adaptation and frugal labelling with diversity-/cluster-aware encoders (DivEn, DivEn-mix, DivEn-c). Labelled teacher clients guide learner clients via confidence-filtered pseudo-labels and domain-adaptive transfer, while clients maintain personalised encoders tailored to local data. To preserve global coherence under heterogeneity, FedFusion employs similarity-weighted classifier coupling (with optional cluster-wise averaging), mitigating dominance by data-rich sites and improving minority-client performance. The frugal-labelling pipeline combines self-/semi-supervised pretext training with selective fine-tuning, reducing annotation demands without sharing raw data. Across tabular and imaging benchmarks under IID, non-IID, and label-scarce regimes, FedFusion consistently outperforms state-of-the-art baselines in accuracy, robustness, and fairness while maintaining comparable communication and computation budgets. These results show that harmonising personalisation, domain adaptation, and label efficiency is an effective recipe for robust federated learning under real-world constraints.

联邦学习标签稀缺领域自适应个性化建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。