arXiv:2505.09385cs.CVcs.AI2025-05IJCAI被引 3

解决联邦语义分割中类别混淆问题,提升跨域一致性

FedSaaS: Class-Consistency Federated Semantic Segmentation via Global Prototype Supervision and Local Adversarial Harmonization

  • 用全局类原型与本地对抗机制统一多客户端类别表示
  • 在多个驾驶场景数据集上平均精度显著提升
  • 适合需要高类别一致性的隐私保护图像分割任务

联邦语义分割可在保护数据隐私的前提下实现图像像素级分类。然而,现有方法在处理异构问题(尤其是领域偏移)时,常忽略语义空间中的细粒度类别关系,导致类别表征模糊。为此,我们提出一种新框架 FedSaaS,通过引入类样本作为局部与全局层级的类别表征标准。服务器端利用上传的类样本建模类别原型,监督客户端的全局分支,确保与全局表征对齐;客户端则引入对抗机制,调和全局与局部分支的贡献,实现输出一致性。此外,双侧采用多层次对比损失,强化同一语义空间中两级表征的一致性。在多个驾驶场景分割数据集上的实验表明,该框架优于现有最先进方法,显著提升平均分割精度,并有效解决类别一致性表征问题。

原文摘要 · Abstract (English)

Federated semantic segmentation enables pixel-level classification in images through collaborative learning while maintaining data privacy. However, existing research commonly overlooks the fine-grained class relationships within the semantic space when addressing heterogeneous problems, particularly domain shift. This oversight results in ambiguities between class representation. To overcome this challenge, we propose a novel federated segmentation framework that strikes class consistency, termed FedSaaS. Specifically, we introduce class exemplars as a criterion for both local- and global-level class representations. On the server side, the uploaded class exemplars are leveraged to model class prototypes, which supervise global branch of clients, ensuring alignment with global-level representation. On the client side, we incorporate an adversarial mechanism to harmonize contributions of global and local branches, leading to consistent output. Moreover, multilevel contrastive losses are employed on both sides to enforce consistency between two-level representations in the same semantic space. Extensive experiments on several driving scene segmentation datasets demonstrate that our framework outperforms state-of-the-art methods, significantly improving average segmentation accuracy and effectively addressing the class-consistency representation problem.

联邦学习语义分割类别一致性对比学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。