arXiv:2410.06976cs.LG2024-10ICLR被引 13

针对图神经网络结构漂移问题,提出测试时自适应方法Matcha。

Matcha: Mitigating Graph Structure Shifts with Test-Time Adaptation

  • 通过调整GNN的top-aggregation参数,动态适应图结构变化。
  • 在多种合成与真实数据集上,显著提升结构漂移场景下的模型性能。
  • 可与现有TTA方法融合,同时应对属性与结构双重漂移,适合图学习应用者。

强大的图神经网络(GNN)易受分布偏移影响。最近,测试时自适应(TTA)因其无需访问源域即可适应目标域而受到关注。然而,现有TTA算法主要针对视觉任务中的属性漂移设计,样本相互独立;在经历结构漂移的图数据上表现不佳,因节点连接性在源与目标图间差异显著。我们指出,结构漂移会严重降低节点表示质量并模糊类别边界。为此,我们提出Matcha,一种通过调节GNN中top-aggregation参数来有效且高效适应结构漂移的新框架。为提升表示质量,设计了预测引导的聚类损失,促进不同节点类别形成清晰聚类。此外,Matcha可无缝集成现有TTA算法,在处理属性漂移的同时增强复合漂移下的整体性能。我们在合成与真实世界数据集上验证了其有效性,展现出对各类结构与属性漂移组合的鲁棒性。代码已公开于 https://github.com/baowenxuan/Matcha。

原文摘要 · Abstract (English)

Powerful as they are, graph neural networks (GNNs) are known to be vulnerable to distribution shifts. Recently, test-time adaptation (TTA) has attracted attention due to its ability to adapt a pre-trained model to a target domain, without re-accessing the source domain. However, existing TTA algorithms are primarily designed for attribute shifts in vision tasks, where samples are independent. These methods perform poorly on graph data that experience structure shifts, where node connectivity differs between source and target graphs. We attribute this performance gap to the distinct impact of node attribute shifts versus graph structure shifts: the latter significantly degrades the quality of node representations and blurs the boundaries between different node categories. To address structure shifts in graphs, we propose Matcha, an innovative framework designed for effective and efficient adaptation to structure shifts by adjusting the htop-aggregation parameters in GNNs. To enhance the representation quality, we design a prediction-informed clustering loss to encourage the formation of distinct clusters for different node categories. Additionally, Matcha seamlessly integrates with existing TTA algorithms, allowing it to handle attribute shifts effectively while improving overall performance under combined structure and attribute shifts. We validate the effectiveness of Matcha on both synthetic and real-world datasets, demonstrating its robustness across various combinations of structure and attribute shifts. Our code is available at https://github.com/baowenxuan/Matcha .

图神经网络测试时自适应结构漂移无监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。