用基于分数的生成方法,合成未见环境下的图数据以提升模型泛化能力。
Score-based Conditional Out-of-Distribution Augmentation for Graph Covariate Shift
- 设计条件得分生成模型,动态合成未知环境下的图结构。
- 在多个图数据集上显著提升分布外泛化性能,优于现有增强方法。
- 适合需要强鲁棒性的图学习任务,如跨域节点分类。
训练与测试数据间的分布偏移严重影响图学习模型性能。现有图增强方法通常在输入空间分离稳定特征与环境特征,并对环境特征进行扰动或混合。然而,这些方法严重依赖准确的特征分离,且探索范围受限于训练分布中的已有环境。为此,本文提出一种基于分数的条件图生成增强策略,可生成未见环境下的图结构,同时保持图整体模式的稳定性和有效性。实验表明,该方法显著提升了图模型在分布外场景下的泛化能力。
原文摘要 · Abstract (English)
Distribution shifts between training and testing datasets significantly impair the model performance on graph learning. A commonly-taken causal view in graph invariant learning suggests that stable predictive features of graphs are causally associated with labels, whereas varying environmental features lead to distribution shifts. In particular, covariate shifts caused by unseen environments in test graphs underscore the critical need for out-of-distribution (OOD) generalization. Existing graph augmentation methods designed to address the covariate shift often disentangle the stable and environmental features in the input space, and selectively perturb or mixup the environmental features. However, such perturbation-based methods heavily rely on an accurate separation of stable and environmental features, and their exploration ability is confined to existing environmental features in the training distribution. To overcome these limitations, we introduce a novel distributional augmentation approach enabled by a tailored score-based conditional graph generation strategies to explore and synthesize unseen environments while preserving the validity and stable features of overall graph patterns. Our comprehensive empirical evaluations demonstrate the enhanced effectiveness of our method in improving graph OOD generalization.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。