解决联邦多视图聚类中单视图与多视图客户端混合异构问题。
Bridging Gaps: Federated Multi-View Clustering in Heterogeneous Hybrid Views
- 设计局部协同对比学习,统一单/多视图客户端特征表示。
- 提出全局特异性加权聚合,挖掘混合视图间的互补信息。
- 适合异构数据分布下的联邦聚类任务,提升模型鲁棒性。
联邦多视图聚类(FedMVC)旨在探索分布在多个客户端的多视图数据中的聚类结构。现有方法通常假设客户端同质,且均为单视图或全多视图客户端。然而,在实际场景中,存在单视图与多视图客户端混合、且具有不同程度异构性的复杂情况。本文提出一种新型FedMVC框架,同时应对客户端异构性(客户差距)与视图异构性(视图差距)。为缓解客户差距,设计局部协同对比学习,使单视图与多视图客户端在特征空间保持一致性;为应对视图差距,提出全局特异性加权聚合机制,促使全局模型学习来自混合视图的互补特征。局部与全局机制相互增强,有效挖掘分布式数据的聚类结构。理论分析与大量实验表明,该方法能有效处理异构混合视图场景,优于当前最优方法。代码已开源:https://github.com/5Martina5/FMCSC。
原文摘要 · Abstract (English)
Recently, federated multi-view clustering (FedMVC) has emerged to explore cluster structures in multi-view data distributed on multiple clients. Existing approaches often assume that clients are isomorphic and all of them belong to either single-view clients or multi-view clients. Despite their success, these methods also present limitations when dealing with practical FedMVC scenarios involving heterogeneous hybrid views, where a mixture of both single-view and multi-view clients exhibit varying degrees of heterogeneity. In this paper, we propose a novel FedMVC framework, which concurrently addresses two challenges associated with heterogeneous hybrid views, i.e., client gap and view gap. To address the client gap, we design a local-synergistic contrastive learning approach that helps single-view clients and multi-view clients achieve consistency for mitigating heterogeneity among all clients. To address the view gap, we develop a global-specific weighting aggregation method, which encourages global models to learn complementary features from hybrid views. The interplay between local-synergistic contrastive learning and global-specific weighting aggregation mutually enhances the exploration of the data cluster structures distributed on multiple clients. Theoretical analysis and extensive experiments demonstrate that our method can handle the heterogeneous hybrid views in FedMVC and outperforms state-of-the-art methods. The code is available at \url{https://github.com/5Martina5/FMCSC}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。