提出节点级聚合方法,实现多源无监督图域自适应
Aggregate to Adapt: Node-Centric Aggregation for Multi-Source-Free Graph Domain Adaptation
- 按节点上下文动态聚合多源模型权重,实现细粒度自适应
- 无需访问源数据标签,在多个公开数据集上超越现有最佳方法
- 适用于多种模型和层级别的迁移学习场景,通用性强
无监督图域自适应(UGDA)旨在将标记源图的知识迁移到未标记目标图,以缓解域间差异。现有方法多针对单一源域设计,难以有效利用多源互补知识;且通常假设训练期间可访问源图标签,这在隐私、合规与存储方面不现实。本文研究多源无监督图域自适应,即在不使用源图标签的情况下,仅依赖源预训练模型实现知识迁移。不同于以往在模型层面聚合预测的方法,本文提出GraphATA模型,从节点粒度进行自适应。通过根据每个节点的局部上下文自动聚合多个源模型的权重矩阵,为每个节点参数化专属的图卷积矩阵,实现对图结构数据的动态适应。同时证明了GraphATA可泛化至模型级与层级方法。在多个公开数据集上的实验表明,GraphATA能持续超越近期最优基线,性能提升显著。
原文摘要 · Abstract (English)
Unsupervised graph domain adaptation (UGDA) focuses on transferring knowledge from labeled source graph to unlabeled target graph under domain discrepancies. Most existing UGDA methods are designed to adapt information from a single source domain, which cannot effectively exploit the complementary knowledge from multiple source domains. Furthermore, their assumptions that the labeled source graphs are accessible throughout the training procedure might not be practical due to privacy, regulation, and storage concerns. In this paper, we investigate multi-source-free unsupervised graph domain adaptation, i.e., adapting knowledge from multiple source domains to an unlabeled target domain without utilizing labeled source graphs but relying solely on source pre-trained models. Unlike previous multi-source domain adaptation approaches that aggregate predictions at model level, we introduce a novel model named GraphATA which conducts adaptation at node granularity. Specifically, we parameterize each node with its own graph convolutional matrix by automatically aggregating weight matrices from multiple source models according to its local context, thus realizing dynamic adaptation over graph structured data. We also demonstrate the capability of GraphATA to generalize to both model-centric and layer-centric methods. Comprehensive experiments on various public datasets show that our GraphATA can consistently surpass recent state-of-the-art baselines with different gains.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。