提出频谱对比方法,提升图神经网络在结构差异大场景下的迁移能力
Rethinking Graph Domain Adaptation: A Spectral Contrastive Perspective
- 基于频谱分析分离图的高低频成分,分别处理全局不变与局部特有模式
- 在多个基准数据集上超越现有最优方法,最高提升12.3%
- 适合研究图域适应、频谱学习或需鲁棒迁移的工程应用
图神经网络在诸多领域表现优异,但在域适应任务中常因结构分布差异大而性能下降,且缺乏对可迁移模式的充分探索。传统方法未区分全局与局部模式,导致多层图网络中局部细节被破坏。本文关键洞察是:通过频谱分析可更好理解域偏移——低频成分通常编码域不变的全局模式,高频成分则捕获域特定的局部细节。为此,我们提出FracNet(频率感知对比图网络),包含两个协同模块:将原始图分解为高低频成分,并进行频率感知域适应。同时引入对比学习框架,缓解域适应中的模糊边界问题。此外,提供了严格的理论证明以验证其优越性。大量实验表明,该方法显著优于现有先进方法。
原文摘要 · Abstract (English)
Graph neural networks (GNNs) have achieved remarkable success in various domains, yet they often struggle with domain adaptation due to significant structural distribution shifts and insufficient exploration of transferable patterns. One of the main reasons behind this is that traditional approaches do not treat global and local patterns discriminatingly so that some local details in the graph may be violated after multi-layer GNN. Our key insight is that domain shifts can be better understood through spectral analysis, where low-frequency components often encode domain-invariant global patterns, and high-frequency components capture domain-specific local details. As such, we propose FracNet (\underline{\textbf{Fr}}equency \underline{\textbf{A}}ware \underline{\textbf{C}}ontrastive Graph \underline{\textbf{Net}}work) with two synergic modules to decompose the original graph into high-frequency and low-frequency components and perform frequency-aware domain adaption. Moreover, the blurring boundary problem of domain adaptation is improved by integrating with a contrastive learning framework. Besides the practical implication, we also provide rigorous theoretical proof to demonstrate the superiority of FracNet. Extensive experiments further demonstrate significant improvements over state-of-the-art approaches.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。