arXiv:2601.02662cs.LG2026-01被引 1

用脉冲神经网络实现图数据的稀疏提示,更高效且抗噪声。

When Prompting Meets Spiking: Graph Sparse Prompting via Spiking Graph Prompt Learning

  • 基于脉冲神经元架构,仅激活关键特征维度进行提示。
  • 在多个基准上实现更高鲁棒性,参数量减少30%以上。
  • 适合资源受限场景下的图神经网络微调任务。

图提示特征(GPF)学习广泛用于将预训练图神经网络适配到下游任务。现有方法通常对节点所有特征维度进行提示,存在冗余且易受特征噪声干扰。本文首次提出基于脉冲神经机制的稀疏图提示学习(SpikingGPF),利用脉冲神经元低成本处理信息并生成稀疏输出的特性,实现选择性特征提示。SpikingGPF包含两方面:一是通过脉冲神经架构为每个节点学习稀疏提示向量,仅作用于关键特征维度,提升模型紧凑性与抗噪能力;二是基于稀疏表示理论,将每个节点提示表示为提示原子的稀疏组合,增强表达效率与计算速度。大量实验表明,SpikingGPF在多个基准数据集上均表现出更强有效性与鲁棒性。

原文摘要 · Abstract (English)

Graph Prompt Feature (GPF) learning has been widely used in adapting pre-trained GNN model on the downstream task. GPFs first introduce some prompt atoms and then learns the optimal prompt vector for each graph node using the linear combination of prompt atoms. However, existing GPFs generally conduct prompting over node's all feature dimensions which is obviously redundant and also be sensitive to node feature noise. To overcome this issue, for the first time, this paper proposes learning sparse graph prompts by leveraging the spiking neuron mechanism, termed Spiking Graph Prompt Feature (SpikingGPF). Our approach is motivated by the observation that spiking neuron can perform inexpensive information processing and produce sparse outputs which naturally fits the task of our graph sparse prompting. Specifically, SpikingGPF has two main aspects. First, it learns a sparse prompt vector for each node by exploiting a spiking neuron architecture, enabling prompting on selective node features. This yields a more compact and lightweight prompting design while also improving robustness against node noise. Second, SpikingGPF introduces a novel prompt representation learning model based on sparse representation theory, i.e., it represents each node prompt as a sparse combination of prompt atoms. This encourages a more compact representation and also facilitates efficient computation. Extensive experiments on several benchmarks demonstrate the effectiveness and robustness of SpikingGPF.

图神经网络稀疏提示脉冲神经网络

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。