arXiv:2410.19265cs.LG2024-10综述被引 23

系统梳理图学习在分布偏移下的方法与挑战,助力模型稳定落地。

A Survey of Deep Graph Learning under Distribution Shifts: from Graph Out-of-Distribution Generalization to Adaptation

  • 按模型与数据视角分类现有方法,厘清技术路线
  • 覆盖训练/测试阶段的分布偏移应对策略,涵盖多种偏移类型
  • 适合关注图神经网络鲁棒性与实际应用的研究者

图数据中的分布偏移——即训练与推理阶段数据分布不一致——在真实场景中普遍存在且难以避免,常导致模型性能显著下降,严重威胁图机器学习的可靠性。近年来,针对分布偏移的图学习研究迅速兴起,目标是使模型在分布外(OOD)数据上仍保持良好表现。本文全面综述深度图学习在分布偏移下的最新进展,聚焦三大场景:图级分布外泛化、训练时适应与测试时适应。我们首先形式化问题,分析协变量偏移、概念偏移等常见分布偏移类型。通过构建系统性分类体系,将现有方法分为以模型为中心和以数据为中心两类,深入剖析各类技术手段。同时整理常用数据集以支持后续研究。最后,指出未来潜在方向及挑战,推动该关键领域的持续发展。相关阅读列表持续更新:https://github.com/kaize0409/Awesome-Graph-OOD。

原文摘要 · Abstract (English)

Distribution shifts on graphs -- the discrepancies in data distribution between training and employing a graph machine learning model -- are ubiquitous and often unavoidable in real-world scenarios. These shifts may severely deteriorate model performance, posing significant challenges for reliable graph machine learning. Consequently, there has been a surge in research on graph machine learning under distribution shifts, aiming to train models to achieve satisfactory performance on out-of-distribution (OOD) test data. In our survey, we provide an up-to-date and forward-looking review of deep graph learning under distribution shifts. Specifically, we cover three primary scenarios: graph OOD generalization, training-time graph OOD adaptation, and test-time graph OOD adaptation. We begin by formally formulating the problems and discussing various types of distribution shifts that can affect graph learning, such as covariate shifts and concept shifts. To provide a better understanding of the literature, we introduce a systematic taxonomy that classifies existing methods into model-centric and data-centric approaches, investigating the techniques used in each category. We also summarize commonly used datasets in this research area to facilitate further investigation. Finally, we point out promising research directions and the corresponding challenges to encourage further study in this vital domain. We also provide a continuously updated reading list at https://github.com/kaize0409/Awesome-Graph-OOD.

图学习分布偏移OOD泛化综述

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。