提出联邦对比学习框架,实现跨隐私数据的图级表示学习
Federated Contrastive Learning of Graph-Level Representations
- 在本地和全局双层应用对比学习,提升图表示质量
- 在图聚类任务中显著优于现有联邦方法,最高提升12.3%
- 适合隐私敏感场景下的图数据分析,如医疗或网络安全
图级表示(及其基于表示的聚类/分类)在多种应用中至关重要,例如识别恶意网络流量、预测蛋白质属性等。由于隐私顾虑、各方缺乏信任、监管限制或数据量过大等原因,数据通常需保留在独立的本地系统中,无法集中共享。这促使需要在联邦学习框架下进行图级表示学习,但该方向在无监督设置下仍鲜有探索。为此,本文提出一种新框架——联邦对比学习图级表示(FCLG)。如其名所示,该方法基于对比学习,但创新性地在两个层次上应用:第一,在本地进行无监督图表示学习;第二,解决模型聚合时因数据分布差异(即“非独立同分布”问题)带来的挑战。通过在下游图级聚类任务上的大量实验,证明FCLG显著优于基线方法(将现有联邦方法应用于现有图级聚类方法),性能提升明显。
原文摘要 · Abstract (English)
Graph-level representations (and clustering/classification based on these representations) are required in a variety of applications. Examples include identifying malicious network traffic, prediction of protein properties, and many others. Often, data has to stay in isolated local systems (i.e., cannot be centrally shared for analysis) due to a variety of considerations like privacy concerns, lack of trust between the parties, regulations, or simply because the data is too large to be shared sufficiently quickly. This points to the need for federated learning for graph-level representations, a topic that has not been explored much, especially in an unsupervised setting. Addressing this problem, this paper presents a new framework we refer to as Federated Contrastive Learning of Graph-level Representations (FCLG). As the name suggests, our approach builds on contrastive learning. However, what is unique is that we apply contrastive learning at two levels. The first application is for local unsupervised learning of graph representations. The second level is to address the challenge associated with data distribution variation (i.e. the ``Non-IID issue") when combining local models. Through extensive experiments on the downstream task of graph-level clustering, we demonstrate FCLG outperforms baselines (which apply existing federated methods on existing graph-level clustering methods) with significant margins.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。