arXiv:2603.29633cs.CV2026-03

针对稀标签藻类分类,提出可区分异构性的自监督联邦学习方法

Self-Supervised Federated Learning under Data Heterogeneity for Label-Scarce Diatom Classification

  • 设计新划分方案PreDi,分离标签分布的频次与集合大小两个维度
  • 发现标签频次主导性能,低频类在异构场景下表现更差
  • 提出PreP-WFL模型,动态增强罕见类别表征,提升小样本适应能力

在去中心化且数据异构的条件下,稀标签视觉分类是模式识别中的基础挑战,尤其当各站点存在部分重叠的类别集合时。现有自监督联邦学习(SSFL)研究通常假设预训练与微调阶段的数据异构模式一致,且现有划分方案难以生成纯的类别不交集设置,限制了对真实世界标签空间异构性的可控模拟。本文以硅藻分类为例,系统研究分阶段的数据异构性:预训练阶段跨站点未标注数据量的差异,以及下游微调阶段的标签空间错位。为此,提出PreDi划分方案,将标签空间异构解耦为类别频次(Prevalence)和类别集合大小差异(Disparity)两个正交维度,实现独立分析其影响。基于此,进一步提出基于频次的个性化加权联邦学习(PreP-WFL),在低频类场景中自适应强化稀有类别表征。大量实验表明,SSFL在同质与异质设置下均优于本地训练;未标注数据量的显著异构有助于提升表征预训练效果,而标签空间异构中,频次主导性能,差异影响较小。PreP-WFL有效缓解性能下降,增益随频次降低而增大。这些发现为去中心化识别系统中的标签空间异构提供了机制性理解。

原文摘要 · Abstract (English)

Label-scarce visual classification under decentralized and heterogeneous data is a fundamental challenge in pattern recognition, especially when sites exhibit partially overlapping class sets. While self-supervised federated learning (SSFL) offers a promising solution, existing studies commonly assume the same data heterogeneity pattern throughout pre-training and fine-tuning. Moreover, current partitioning schemes often fail to generate pure partially class-disjoint data settings, limiting controllable simulation of real-world label-space heterogeneity. In this work, we introduce SSFL for diatom classification as a representative real-world instance and systematically investigate stage-specific data heterogeneity. We study cross-site variation in unlabeled data volume during pre-training and label-space misalignment during downstream fine-tuning. To study the latter in a controllable setting, we propose PreDi, a partitioning scheme that disentangles label-space heterogeneity into two orthogonal dimensions, namely class Prevalence and class-set size Disparity, enabling separate analysis of their effects. Guided by the resulting insights, we further propose PreP-WFL (Prevalence-based Personalized Weighted Federated Learning) to adaptively strengthen rare-class representations in low-prevalence scenarios. Extensive experiments show that SSFL consistently outperforms local-only training under both homogeneous and heterogeneous settings. The pronounced heterogeneity in unlabeled data volume is associated with improved representation pre-training, whereas under label-space heterogeneity, prevalence dominates performance and disparity has a smaller effect. PreP-WFL effectively mitigates this degradation, with gains increasing as prevalence decreases. These findings provide a mechanistic basis for characterizing label-space heterogeneity in decentralized recognition systems.

联邦学习自监督稀标签异构数据

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。