通过调整图结构同质性,提升预训练模型在测试时的鲁棒性。
Does Homophily Help in Robust Test-time Node Classification?
- 根据同质性预测动态重构测试图结构,无需重新训练模型。
- 在9个数据集上最高提升10.92%,显著改善测试性能。
- 适合应对数据质量差或分布偏移的真实场景,如社交网络与引用网络。
同质性指同一类节点间更易连接,是引文网络和社交网络等真实图数据的基本特性。现有方法多在训练阶段利用同质性设计图神经网络架构或结构学习策略,但未考虑测试阶段的分布偏移与数据质量问题。本文通过实证与理论分析发现:在同质图中增强同质性、在异质图中降低同质性,可显著提升预训练GNN在测试时的鲁棒性与分类性能,且无需模型更新。基于此提出新方法GrapHoST,通过同质性预测器识别测试边,并依据预测置信度自适应重构图结构。在9个基准数据集上,面对多种测试时数据质量挑战,GrapHoST持续达到当前最优表现,最高提升达10.92%。代码已开源。
原文摘要 · Abstract (English)
Homophily, the tendency of nodes from the same class to connect, is a fundamental property of real-world graphs, underpinning structural and semantic patterns in domains such as citation networks and social networks. Existing methods exploit homophily through designing homophily-aware GNN architectures or graph structure learning strategies, yet they primarily focus on GNN learning with training graphs. However, in real-world scenarios, test graphs often suffer from data quality issues and distribution shifts, such as domain shifts across users from different regions in social networks and temporal evolution shifts in citation network graphs collected over varying time periods. These factors significantly compromise the pre-trained model's robustness, resulting in degraded test-time performance. With empirical observations and theoretical analysis, we reveal that transforming the test graph structure by increasing homophily in homophilic graphs or decreasing it in heterophilic graphs can significantly improve the robustness and performance of pre-trained GNNs on node classifications, without requiring model training or update. Motivated by these insights, a novel test-time graph structural transformation method grounded in homophily, named GrapHoST, is proposed. Specifically, a homophily predictor is developed to discriminate test edges, facilitating adaptive test-time graph structural transformation by the confidence of predicted homophily scores. Extensive experiments on nine benchmark datasets under a range of test-time data quality issues demonstrate that GrapHoST consistently achieves state-of-the-art performance, with improvements of up to 10.92%. Our code has been released at https://github.com/YanJiangJerry/GrapHoST.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。