提出迭代式图增强框架,提升模型在缺陷数据下的鲁棒性
Are LLMs Better GNN Helpers? Rethinking Robust Graph Learning under Deficiencies with Iterative Refinement
- 用检索增强生成实现动态迭代增广,替代一次性注入
- 在多种缺陷组合下实现最高82.43%的性能提升
- 适合需要高鲁棒性的图学习应用场景
图神经网络(GNN)广泛应用于网络相关任务中,用于处理文本属性图等图结构数据。然而在实际场景中,图数据常存在多种缺陷,严重削弱GNN性能。现有研究多聚焦单一缺陷的鲁棒性提升,缺乏对图原生方法与大语言模型(LLM)增强方法在复合缺陷下的系统性比较。本文首次开展跨缺陷类型的基准测试,揭示了现有方法的隐藏脆弱性,并挑战了LLM增强始终更优的假设。基于实证发现,我们提出鲁棒图学习框架RoGRAD,采用检索增强生成(RAG)机制,通过提供类别一致且多样化的增广信息,结合迭代图对比学习,强制学习判别性表示。该框架将LLM增广从静态信号注入转变为动态优化过程。大量实验表明,RoGRAD在多项指标上优于传统GNN及LLM增强基线,平均性能提升达82.43%。
原文摘要 · Abstract (English)
Graph Neural Networks (GNNs) are widely adopted in Web-related applications, serving as a core technique for learning from graph-structured data, such as text-attributed graphs. Yet in real-world scenarios, such graphs exhibit deficiencies that substantially undermine GNN performance. While prior GNN-based augmentation studies have explored robustness against individual imperfections, a systematic understanding of how graph-native and Large Language Models (LLMs) enhanced methods behave under compound deficiencies is still missing. Specifically, there has been no comprehensive investigation comparing conventional approaches and recent LLM-on-graph frameworks, leaving their merits unclear. To fill this gap, we conduct the first empirical study that benchmarks these two lines of methods across diverse graph deficiencies, revealing overlooked vulnerabilities and challenging the assumption that LLM augmentation is consistently superior. Building on empirical findings, we propose Robust Graph Learning via Retrieval-Augmented Contrastive Refinement (RoGRAD) framework. Unlike prior one-shot LLM-as-Enhancer designs, RoGRAD is the first iterative paradigm that leverages Retrieval-Augmented Generation (RAG) to inject retrieval-grounded augmentations by supplying class-consistent, diverse augmentations and enforcing discriminative representations through iterative graph contrastive learning. It transforms LLM augmentation for graphs from static signal injection into dynamic refinement. Extensive experiments demonstrate RoGRAD's superiority over both conventional GNN- and LLM-enhanced baselines, achieving up to 82.43% average improvement.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。