arXiv:2509.12544cs.CV2025-09被引 1

针对标签分布偏斜的多标签联邦学习,提出新框架提升模型性能。

Neural Collapse-Inspired Multi-Label Federated Learning under Label-Distribution Skew

  • 基于神经坍缩理论设计特征对齐机制,促进客户端特征聚类。
  • 在五大数据集上实现最高3.92%的类别AUC和4.93%的F1提升。
  • 适合处理标签不平衡、数据异构的多标签实际应用场景。

联邦学习(FL)可在保护数据隐私的前提下实现跨客户端协同建模,但在客户端数据高度异构时仍具挑战性。这一问题在多标签场景中尤为突出,因标签间依赖关系复杂且局部与全局标签关系不一致,导致优化冲突加剧。尽管多数现有研究聚焦单标签分类,但现实应用多为多标签且常存在严重标签偏斜。为此,本文提出FedNCA-ML框架,受神经坍缩(NC)理论启发,使客户端特征向量收敛至类均值并形成最大分离的单纯形结构,从而学习判别性强且聚类良好的特征。进一步引入注意力模块提取类别特异性表示,在极端标签不平衡下实现更均衡的学习。通过共享的NC式结构对齐各客户端特征,缓解由异构数据和不一致标签依赖带来的冲突。同时设计正则化损失以增强潜在空间中的紧凑性和一致性。在五个基准数据集、九种联邦设置下实验表明,该方法在类别级AUC上最高提升3.92%,类别级F1得分提升4.93%。

原文摘要 · Abstract (English)

Federated Learning (FL) enables collaborative model training across distributed clients while preserving data privacy, but remains challenging when client data are highly heterogeneous. These challenges are further amplified in multi-label scenarios, where inter-label dependencies and mismatches between local and global label relationships introduce additional optimization conflicts. While most FL studies focus on single-label classification, many real-world applications are inherently multi-label and often exhibit severe label skew across clients. To address this important yet underexplored problem, we propose FedNCA-ML, a novel FL framework that aligns client representations and learns discriminative, well-clustered features inspired by Neural Collapse (NC) theory. NC describes an ideal latent geometry where each class's features collapse to their mean, forming a maximally separated simplex. FedNCA-ML further introduces an attention-based module to extract class-specific representations, enabling more balanced learning under heavy label imbalance. These class-wise representations are then aligned via a shared NC-inspired structure, mitigating inter-client conflicts induced by heterogeneous local data and inconsistent label dependencies. In addition, we design regularisation losses to encourage compact and consistent feature clustering in the latent space. Experiments on five benchmark datasets under nine FL settings demonstrate the effectiveness of the proposed method, achieving improvements of up to 3.92% in class-wise AUC and 4.93% in class-wise F1 score.

联邦学习多标签特征对齐标签偏斜

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。