arXiv:2604.19729cs.LGcs.IT2026-04被引 1

用特征空间结构分组用户,抗噪能力强,提升个性化联邦学习效果

FB-NLL: A Feature-Based Approach to Tackle Noisy Labels in Personalized Federated Learning

论文配图:FB-NLL: A Feature-Based Approach to Tackle Noisy Labels in Personalized Federated Learning
图 1 · 摘自论文原文
  • 基于特征协方差谱结构进行一次性聚类,不依赖训练过程
  • 在多个数据集上平均准确率超越当前最优基线,性能更稳定
  • 无需估计噪声转移矩阵,适合存在标签错误的场景

个性化联邦学习(PFL)旨在为异构数据分布下的不同用户提供专属模型。现有方法多依赖迭代优化轨迹进行用户聚类,但易受低质量数据和噪声标签影响,因异常更新会扭曲聚类结果。为此,本文提出FB-NLL,一种以特征为中心的框架,将用户聚类与训练动态解耦。通过分析本地特征表示的协方差谱结构,利用子空间相似性识别任务一致的用户分组,实现无需标签的单次聚类,显著降低通信与计算开销。同时引入基于特征一致性的检测与修正策略:利用学习特征空间中的方向对齐,结合类别特定子空间分配标签,无需估计随机噪声转移矩阵即可缓解污染监督。该方法与模型无关,可无缝集成现有抗噪训练技术。在多种数据集和噪声环境下实验表明,该框架在平均准确率和性能稳定性上持续优于先进基线。

原文摘要 · Abstract (English)

Personalized Federated Learning (PFL) aims to learn multiple task-specific models rather than a single global model across heterogeneous data distributions. Existing PFL approaches typically rely on iterative optimization-such as model update trajectories-to cluster users that need to accomplish the same tasks together. However, these learning-dynamics-based methods are inherently vulnerable to low-quality data and noisy labels, as corrupted updates distort clustering decisions and degrade personalization performance. To tackle this, we propose FB-NLL, a feature-centric framework that decouples user clustering from iterative training dynamics. By exploiting the intrinsic heterogeneity of local feature spaces, FB-NLL characterizes each user through the spectral structure of the covariances of their feature representations and leverages subspace similarity to identify task-consistent user groupings. This geometry-aware clustering is label-agnostic and is performed in a one-shot manner prior to training, significantly reducing communication overhead and computational costs compared to iterative baselines. Complementing this, we introduce a feature-consistency-based detection and correction strategy to address noisy labels within clusters. By leveraging directional alignment in the learned feature space and assigning labels based on class-specific feature subspaces, our method mitigates corrupted supervision without requiring estimation of stochastic noise transition matrices. In addition, FB-NLL is model-independent and integrates seamlessly with existing noise-robust training techniques. Extensive experiments across diverse datasets and noise regimes demonstrate that our framework consistently outperforms state-of-the-art baselines in terms of average accuracy and performance stability.

联邦学习抗噪特征聚类个性化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。