arXiv:2505.19024cs.LGstat.ML2025-05ICML被引 58

让噪声成为图数据增强的智能助手,提升图对比学习的稳定性和效果。

Learn Beneficial Noise as Graph Augmentation

  • 基于信息论设计可学习的有益噪声生成器,替代随机扰动。
  • 在多个图数据集上显著提升对比学习性能,稳定性优于传统方法。
  • 适合需要稳定训练的图神经网络研究者和应用开发者。

尽管图对比学习(GCL)已被广泛研究,但生成有效且稳定的图增强仍具挑战。现有方法常采用随机边删除等启发式策略,可能破坏重要图结构,导致性能不稳定。本文提出正向激励噪声驱动的图数据增强方法(PiNGDA),其中正向激励噪声(pi-noise)从信息论角度分析噪声的有益作用。为连接标准GCL与pi-noise框架,我们引入高斯辅助变量,将损失函数转化为信息熵形式。理论证明,标准GCL中预定义增强相当于对有益噪声进行点估计。基于此分析,PiNGDA通过可训练的噪声生成器,在拓扑和属性两个层面学习产生有益扰动,而非简单估计。由于生成器能自动学习如何生成有效的图扰动,该方法比现有方法更可靠。大量实验验证了PiNGDA的有效性与稳定性。

原文摘要 · Abstract (English)

Although graph contrastive learning (GCL) has been widely investigated, it is still a challenge to generate effective and stable graph augmentations. Existing methods often apply heuristic augmentation like random edge dropping, which may disrupt important graph structures and result in unstable GCL performance. In this paper, we propose Positive-incentive Noise driven Graph Data Augmentation (PiNGDA), where positive-incentive noise (pi-noise) scientifically analyzes the beneficial effect of noise under the information theory. To bridge the standard GCL and pi-noise framework, we design a Gaussian auxiliary variable to convert the loss function to information entropy. We prove that the standard GCL with pre-defined augmentations is equivalent to estimate the beneficial noise via the point estimation. Following our analysis, PiNGDA is derived from learning the beneficial noise on both topology and attributes through a trainable noise generator for graph augmentations, instead of the simple estimation. Since the generator learns how to produce beneficial perturbations on graph topology and node attributes, PiNGDA is more reliable compared with the existing methods. Extensive experimental results validate the effectiveness and stability of PiNGDA.

图学习数据增强信息论噪声学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。