arXiv:2410.16606cs.LGcs.AI2024-10TPAMI被引 31

针对无源图数据域适应,提出基于图扩散与拼图混合的新方法。

GALA: Graph Diffusion-based Alignment with Jigsaw for Source-free Domain Adaptation

  • 用图扩散模型从目标数据重建源风格图
  • 通过拼图策略混合置信与不置信图,提升泛化能力
  • 适用于隐私敏感场景的图数据迁移学习

无源域适应是机器学习中的关键问题,尤其在保护数据隐私的现实应用中意义重大。现有方法主要针对欧氏数据(如图像、视频),对非欧氏图数据的研究较少。当前图神经网络方法在无源域适应中易受域偏移和标签稀缺影响,性能显著下降。本文提出一种新方法GALA,专为无源图域适应设计。GALA利用图扩散模型,基于源图训练生成模型以学习源风格特征;通过随机微分方程对目标图施加扰动,并反向过程重建源风格图。将重建图输入预训练GNN,结合类别特定阈值与课程学习生成准确且无偏的伪标签。此外,提出简单有效的图拼图策略,融合高置信与低置信图,通过一致性学习增强模型泛化性与鲁棒性。大量实验在基准数据集上验证了GALA的有效性。

原文摘要 · Abstract (English)

Source-free domain adaptation is a crucial machine learning topic, as it contains numerous applications in the real world, particularly with respect to data privacy. Existing approaches predominantly focus on Euclidean data, such as images and videos, while the exploration of non-Euclidean graph data remains scarce. Recent graph neural network (GNN) approaches can suffer from serious performance decline due to domain shift and label scarcity in source-free adaptation scenarios. In this study, we propose a novel method named Graph Diffusion-based Alignment with Jigsaw (GALA), tailored for source-free graph domain adaptation. To achieve domain alignment, GALA employs a graph diffusion model to reconstruct source-style graphs from target data. Specifically, a score-based graph diffusion model is trained using source graphs to learn the generative source styles. Then, we introduce perturbations to target graphs via a stochastic differential equation instead of sampling from a prior, followed by the reverse process to reconstruct source-style graphs. We feed the source-style graphs into an off-the-shelf GNN and introduce class-specific thresholds with curriculum learning, which can generate accurate and unbiased pseudo-labels for target graphs. Moreover, we develop a simple yet effective graph-mixing strategy named graph jigsaw to combine confident graphs and unconfident graphs, which can enhance generalization capabilities and robustness via consistency learning. Extensive experiments on benchmark datasets validate the effectiveness of GALA.

图神经网络域适应扩散模型无源学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。