通过可学习权重调整图传播几何,提升长程信息传递效率
Geometry-Induced Diffusion on Graphs: A Learnable Weighted Laplacian for Spectral GNNs
- 用可学习的节点权重μ构建加权拉普拉斯算子,动态调整传播路径
- 在合成与真实数据集上均显著提升长程推理性能,减少层数需求
- 轻量级设计替代注意力机制,且权重具有可解释性
图神经网络在长距离图任务中面临挑战:全局机制如注意力或重连策略计算开销大,而深层局部传播易导致梯度消失、过度平滑和过度挤压。本文提出mu-ChebNet架构,一种简单的谱图神经网络,先学习节点级权重函数μ,再应用类似ChebNet的滤波器。该学习权重μ诱导出修改后的图拉普拉斯算子,有效改变传播几何而不改变图拓扑结构。这种任务相关的传播几何能引导信息走优选路径,避免高收缩瓶颈,从而无需反复堆叠层。实践中,将固定图拉普拉斯算子L替换为学习得到的L_mu,使mu-ChebNet保持轻量化的同时实现传播任务自适应。我们还提供了谱分析证明μ如何调节传播动力学,并在合成长程推理任务和真实世界图基准上观察到性能提升。学习到的权重函数不仅可解释,还可作为注意力与重连的轻量级替代方案。
原文摘要 · Abstract (English)
Long-range graph tasks are challenging for Graph Neural Networks (GNNs): global mechanisms such as attention or rewiring schemes can be computationally expensive, while deep local propagation is prone to vanishing gradients, oversmoothing, and oversquashing. The introduced mu-ChebNet architecture is a simple spectral GNN that learns a node-wise weight function mu before applying ChebNet-style filters. The learned weighting mu induces a modified graph Laplacian which effectively changes the propagation geometry without altering the graph topology. This task-dependent geometry promotes preferred routes for information propagation, thereby helping long-range signals avoid highly contractive bottlenecks, and obviating the need for repeated layer stacking. In practice, we replace the fixed graph Laplacian L by a learned operator L_mu, keeping the proposed mu-ChebNet architecture lightweight while making propagation task-adaptive. Furthermore, we provide a spectral analysis demonstrating how mu modulates propagation dynamics, and empirically observe improved performance on both synthetic long-range reasoning tasks and real-world graph benchmarks. The learned weight function is not only interpretable, but also offers a lightweight alternative to attention and rewiring for adaptive graph propagation.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。