提出新指标TFI,区分特征对GNN的有益或有害影响。
Is Graph Convolution Always Beneficial For Every Feature?
- 设计拓扑特征信息量(TFI)度量,判断特征是否适合图卷积
- 所提特征选择方法使83.75%场景性能提升,且计算成本相近
- 适用于各类GNN架构,对超参不敏感,具通用性
图神经网络(GNN)在处理结构化数据方面表现优异。然而,传统GNN对各特征维度一视同仁地进行图卷积,我们提出关键问题:图卷积对每个特征是否都有效?若非如此,某些特征上的卷积可能产生负面效果,甚至劣于无卷积模型。现有基于特征同质性的度量与GNN性能关联性差,未能有效指导特征选择。为此,本文提出全新度量——拓扑特征信息量(TFI),通过理论分析与实证验证其有效性。基于TFI,提出图特征选择(GFS)方法,分别对有利与不利特征使用GNN和非GNN模型。相比原模型,GFS在保持相似计算成本下显著提升各特征的拓扑信息提取能力。在10个数据集上对8种基线及先进GNN架构应用后,83.75%的案例性能显著提升。同时,TFI优于其他特征选择方法。结果验证了GFS与TFI的有效性,且改进对超参数调优稳健,具有普适增强潜力。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) have demonstrated strong capabilities in processing structured data. While traditional GNNs typically treat each feature dimension equally during graph convolution, we raise an important question: Is the graph convolution operation equally beneficial for each feature? If not, the convolution operation on certain feature dimensions can possibly lead to harmful effects, even worse than the convolution-free models. In prior studies, to assess the impacts of graph convolution on features, people proposed metrics based on feature homophily to measure feature consistency with the graph topology. However, these metrics have shown unsatisfactory alignment with GNN performance and have not been effectively employed to guide feature selection in GNNs. To address these limitations, we introduce a novel metric, Topological Feature Informativeness (TFI), to distinguish between GNN-favored and GNN-disfavored features, where its effectiveness is validated through both theoretical analysis and empirical observations. Based on TFI, we propose a simple yet effective Graph Feature Selection (GFS) method, which processes GNN-favored and GNN-disfavored features separately, using GNNs and non-GNN models. Compared to original GNNs, GFS significantly improves the extraction of useful topological information from each feature with comparable computational costs. Extensive experiments show that after applying GFS to 8 baseline and state-of-the-art (SOTA) GNN architectures across 10 datasets, 83.75% of the GFS-augmented cases show significant performance boosts. Furthermore, our proposed TFI metric outperforms other feature selection methods. These results validate the effectiveness of both GFS and TFI. Additionally, we demonstrate that GFS's improvements are robust to hyperparameter tuning, highlighting its potential as a universal method for enhancing various GNN architectures.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。