提出首个非独立同分布图数据的渐进域适应框架,解决大分布偏移问题。
Pave Your Own Path: Graph Gradual Domain Adaptation on Fused Gromov-Wasserstein Geodesics
- 用融合格罗莫夫-沃瑟斯坦距离构建图域差异度量,理论证明路径越长误差越大
- 发现并构造最优路径——FGW测地线,使模型在真实数据集上准确率提升最高6.8%
- 适用于实际中分布差异大的图数据场景,尤其适合已有图神经网络方法增强
图神经网络虽性能优异,但对图上的分布偏移极为敏感。现有图域适应方法通常隐含假设源域与目标域间偏移较小,限制了其在真实场景中应对大幅偏移的能力。渐进域适应(GDA)通过一系列未标记的中间域逐步将源模型迁移到目标域,是应对大偏移的有前景方法。然而,现有GDA方法仅关注独立同分布(IID)数据且需预定义路径,尚未解决非独立同分布图数据无路径时的扩展问题。为此,我们提出Gadget,首个面向非独立同分布图数据的GDA框架。首先(理论基础),采用融合格罗莫夫-沃瑟斯坦(FGW)距离作为非独立同分布图的域差异度量,并据此推导出节点、边和图层级任务的误差界,表明目标域误差与路径长度成正比。其次(最优路径),基于该误差界,我们识别出FGW测地线为最优路径,可通过所提算法高效生成。生成的路径可无缝集成至现有图域适应方法,有效处理图上的大分布偏移,在真实数据集上使最先进图域适应方法准确率最高提升6.8%。
原文摘要 · Abstract (English)
Graph neural networks, despite their impressive performance, are highly vulnerable to distribution shifts on graphs. Existing graph domain adaptation (graph DA) methods often implicitly assume a mild shift between source and target graphs, limiting their applicability to real-world scenarios with large shifts. Gradual domain adaptation (GDA) has emerged as a promising approach for addressing large shifts by gradually adapting the source model to the target domain via a path of unlabeled intermediate domains. Existing GDA methods exclusively focus on independent and identically distributed (IID) data with a predefined path, leaving their extension to non-IID graphs without a given path an open challenge. To bridge this gap, we present Gadget, the first GDA framework for non-IID graph data. First (theoretical foundation), the Fused Gromov-Wasserstein (FGW) distance is adopted as the domain discrepancy for non-IID graphs, based on which, we derive an error bound on node, edge and graph-level tasks, showing that the target domain error is proportional to the length of the path. Second (optimal path), guided by the error bound, we identify the FGW geodesic as the optimal path, which can be efficiently generated by our proposed algorithm. The generated path can be seamlessly integrated with existing graph DA methods to handle large shifts on graphs, improving state-of-the-art graph DA methods by up to 6.8% in accuracy on real-world datasets.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。