arXiv:2506.14220cs.LG2025-06

用大模型预测图同质性,提升谱图神经网络在少标签场景下的表现。

Enhancing Spectral Graph Neural Networks with LLM-Predicted Homophily

  • 通过自然语言提示让大模型估计图的同质性比例,提供全局结构先验。
  • 在多个基准数据集上,性能优于主流谱图神经网络基线,尤其在异质图上显著提升。
  • 无需修改图结构或额外训练,计算开销极低,适合实际部署。

谱图神经网络(SGNNs)在节点分类等任务中表现优异,因其能学习灵活的滤波器。通常这些滤波器在下游任务监督下学习,以适应多样化的结构模式。然而,在标签数据有限的情况下,SGNNs难以捕捉最优滤波器形状,尤其在异质图上性能下降明显。大型语言模型(LLMs)的快速发展为不改变图结构或无需任务特定训练的图学习提供了新可能。本文提出一种新框架,利用LLM估计图的同质性水平,并以此全局结构先验指导谱滤波器的构建。具体而言,设计了一个轻量级、即插即用的流程:将少量标注节点对格式化为自然语言提示输入给LLM,由其预测图的同质性比率;该估计值用于调节谱滤波器基,使SGNN能更有效适应同质与异质结构。大量实验表明,该基于LLM的谱框架在多个基准数据集上持续优于强基线,且增强带来的计算和成本开销可忽略不计,适用于真实世界图应用。

原文摘要 · Abstract (English)

Spectral Graph Neural Networks (SGNNs) have achieved remarkable performance in tasks such as node classification due to their ability to learn flexible filters. Typically, these filters are learned under the supervision of downstream tasks, enabling SGNNs to adapt to diverse structural patterns. However, in scenarios with limited labeled data, SGNNs often struggle to capture the optimal filter shapes, resulting in degraded performance, especially on graphs with heterophily. Meanwhile, the rapid progress of Large Language Models (LLMs) has opened new possibilities for enhancing graph learning without modifying graph structure or requiring task-specific training. In this work, we propose a novel framework that leverages LLMs to estimate the homophily level of a graph and uses this global structural prior to guide the construction of spectral filters. Specifically, we design a lightweight and plug-and-play pipeline where a small set of labeled node pairs is formatted as natural language prompts for the LLM, which then predicts the graph's homophily ratio. This estimated value informs the spectral filter basis, enabling SGNNs to adapt more effectively to both homophilic and heterophilic structures. Extensive experiments on multiple benchmark datasets demonstrate that our LLM-assisted spectral framework consistently improves performance over strong SGNN baselines. Importantly, this enhancement incurs negligible computational and monetary cost, making it a practical solution for real-world graph applications.

谱图神经网络大模型同质性少样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。