通过抑制吉布斯现象,改进切比雪夫图卷积网络性能。
From ChebNet to ChebGibbsNet
- 用切比雪夫多项式加阻尼因子缓解吉布斯现象
- 在同质与异质图上均超越GPR-GNN和BernNet
- 轻量级改进,无需额外参数或复杂结构
近年来,谱图卷积网络(SpecGCNs)在各类图表示学习任务中取得了顶尖性能。为挖掘其潜力,我们通过多项式插值分析对应图滤波器,这是图信号处理的核心。不同多项式基(如伯恩斯坦、切比雪夫、单项式)具有不同的收敛速度,影响插值误差。尽管采用切比雪夫基可最小化最大误差,但ChebNet性能仍弱于GPR-GNN和BernNet。我们指出,这是由于图频响应函数逼近目标函数时出现的吉布斯现象,降低了截断多项式插值的逼近能力。为此,我们在切比雪夫多项式每一项上引入吉布斯阻尼因子,显著提升性能。随后,我们通过解耦特征传播与变换重构了ChebNet,提出新模型ChebGibbsNet。实验表明,该模型在同质图和异质图上均优于GPR-GNN、BernNet等先进SpecGCN模型。
原文摘要 · Abstract (English)
Recent advancements in Spectral Graph Convolutional Networks (SpecGCNs) have led to state-of-the-art performance in various graph representation learning tasks. To exploit the potential of SpecGCNs, we analyze corresponding graph filters via polynomial interpolation, the cornerstone of graph signal processing. Different polynomial bases, such as Bernstein, Chebyshev, and monomial basis, have various convergence rates that will affect the error in polynomial interpolation. Although adopting Chebyshev basis for interpolation can minimize maximum error, the performance of ChebNet is still weaker than GPR-GNN and BernNet. \textbf{We point out it is caused by the Gibbs phenomenon, which occurs when the graph frequency response function approximates the target function.} It reduces the approximation ability of a truncated polynomial interpolation. In order to mitigate the Gibbs phenomenon, we propose to add the Gibbs damping factor with each term of Chebyshev polynomials on ChebNet. As a result, our lightweight approach leads to a significant performance boost. Afterwards, we reorganize ChebNet via decoupling feature propagation and transformation. We name this variant as \textbf{ChebGibbsNet}. Our experiments indicate that ChebGibbsNet is superior to other advanced SpecGCNs, such as GPR-GNN and BernNet, in both homogeneous graphs and heterogeneous graphs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。