arXiv:2502.16431cs.LG2025-02被引 17

统一建模连续与离散动态图,提升表示学习效果。

UniDyG: A Unified and Effective Representation Learning Approach for Large Dynamic Graphs

  • 提出傅里叶图注意力机制,同时捕捉局部和全局结构关联。
  • 在九个数据集上平均比基线提升14.4%。
  • 自带抗噪能力,适合大规模动态图分析。

动态图分为连续时间(CTDGs)和离散时间(DTDGs)两类,其时间粒度差异导致表征学习方法各自孤立发展。现有统一模型多聚焦局部时序传播,难以准确捕捉不同粒度下的结构演化。此外,多数工作忽略时序噪声,影响模型鲁棒性。为此,我们提出UniDyG,一种可扩展至大规模动态图的统一表征学习方法。首先设计新型傅里叶图注意力(FGAT)机制,基于近期邻居与复数选择性聚合,理论保证时序一致性;依据逼近理论,证明其适用于两类动态图的底层结构建模。进一步引入能量门控单元,自适应过滤高频噪声。最后,利用FGAT进行时序结构学习,并采用频增强线性函数实现节点级动态更新,生成高质量时序嵌入。大量实验表明,UniDyG在九个动态图上平均优于十六个基线14.4%。

原文摘要 · Abstract (English)

Dynamic graphs are formulated in continuous-time or discrete-time dynamic graphs. They differ in temporal granularity: Continuous-Time Dynamic Graphs (CTDGs) exhibit rapid, localized changes, while Discrete-Time Dynamic Graphs (DTDGs) show gradual, global updates. This difference leads to isolated developments in representation learning for each type. To advance representation learning, recent research attempts to design a unified model capable of handling both CTDGs and DTDGs. However, it typically focuses on local dynamic propagation for temporal structure learning in the time domain, failing to accurately capture the structural evolution associated with each temporal granularity. In addition, existing works-whether specific or unified-often overlook the issue of temporal noise, compromising the model robustness and effectiveness. To better model both types of dynamic graphs, we propose UniDyG, a unified and effective representation learning approach, which scales to large dynamic graphs. We first propose a novel Fourier Graph Attention (FGAT) mechanism that can model local and global structural correlations based on recent neighbors and complex-number selective aggregation, while theoretically ensuring consistent representations of dynamic graphs over time. Based on approximation theory, we demonstrate that FGAT is well-suited to capture the underlying structures in CTDGs and DTDGs. We further enhance FGAT to resist temporal noise by designing an energy-gated unit, which adaptively filters out high-frequency noise according to the energy. Last, we leverage our FGAT mechanisms for temporal structure learning and employ the frequency-enhanced linear function for node-level dynamic updates, facilitating the generation of high-quality temporal embeddings. Extensive experiments show that our UniDyG achieves an average improvement of 14.4% over sixteen baselines across nine dynamic graphs.

动态图表示学习图神经网络抗噪

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。