首次在知识图谱上评测公平性感知GNN,发现其偏差权衡更明显。
Benchmarking Fairness-aware Graph Neural Networks in Knowledge Graphs
- 在YAGO、DBpedia等大图上测试多种公平性GNN方法
- 预处理提升公平性,而内嵌方法更保准确率
- 模型结构与早停策略显著影响结果,非仅公平性算法
图神经网络(GNN)在图结构数据上表现强大,但常对敏感属性产生偏差预测。公平性感知的GNN被广泛研究以缓解此类问题。然而,此前研究尚未在知识图谱这一关键应用场景中评估公平性感知的GNN。为此,本文在三个大型知识图谱——YAGO、DBpedia和Wikidata上构建新图数据集,其规模远超现有公平性研究使用的数据集。我们对不同GNN主干模型、预处理与内嵌方法以及早停策略进行了全面基准测试。研究发现:(i) 知识图谱展现出与以往数据集不同的趋势,公平性感知GNN中准确率与公平性指标间的权衡更清晰;(ii) 性能受公平性方法、GNN主干结构及早停条件的共同影响显著;(iii) 预处理方法通常提升公平性指标,而内嵌方法更利于保持预测准确率。
原文摘要 · Abstract (English)
Graph neural networks (GNNs) are powerful tools for learning from graph-structured data but often produce biased predictions with respect to sensitive attributes. Fairness-aware GNNs have been actively studied for mitigating biased predictions. However, no prior studies have evaluated fairness-aware GNNs on knowledge graphs, which are one of the most important graphs in many applications, such as recommender systems. Therefore, we introduce a benchmarking study on knowledge graphs. We generate new graphs from three knowledge graphs, YAGO, DBpedia, and Wikidata, that are significantly larger than the existing graph datasets used in fairness studies. We benchmark inprocessing and preprocessing methods in different GNN backbones and early stopping conditions. We find several key insights: (i) knowledge graphs show different trends from existing datasets; clearer trade-offs between prediction accuracy and fairness metrics than other graphs in fairness-aware GNNs, (ii) the performance is largely affected by not only fairness-aware GNN methods but also GNN backbones and early stopping conditions, and (iii) preprocessing methods often improve fairness metrics, while inprocessing methods improve prediction accuracy.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。