提出新框架ScaDyG,解决动态图学习的可扩展性难题。
ScaDyG:A New Paradigm for Large-scale Dynamic Graph Learning
- 分时段重构图结构,实现无权重的时间感知传播。
- 用指数函数组合实现细粒度、可扩展的时序编码。
- 超网络驱动消息聚合,自适应融合历史依赖,适合工业级应用。
动态图(DGs)捕捉实体间随时间演化的关系,广泛应用于现实场景。现有动态图神经网络多沿用传统消息传递机制并结合时间技术,但历史交互增长导致显著可扩展性问题,尤其在工业场景中。为此,我们提出ScaDyG,设计一种时间感知的可扩展学习范式:1)时间感知拓扑重构:基于动态建模将历史交互分段为时间步(内部与跨步),预处理阶段实现无权重、时间感知的图传播;2)动态时序编码:为实现时间步内细粒度传播,采用指数函数组合以可扩展方式引入时序编码;3)超网络驱动消息聚合:在获得传播特征后,利用超网络分析历史依赖,通过自适应时序融合实现节点级表征。在12个数据集上的大量实验表明,ScaDyG在节点和链接级下游任务中表现媲美或超越现有最先进方法,参数更少,效率更高。
原文摘要 · Abstract (English)
Dynamic graphs (DGs), which capture time-evolving relationships between graph entities, have widespread real-world applications. To efficiently encode DGs for downstream tasks, most dynamic graph neural networks follow the traditional message-passing mechanism and extend it with time-based techniques. Despite their effectiveness, the growth of historical interactions introduces significant scalability issues, particularly in industry scenarios. To address this limitation, we propose ScaDyG, with the core idea of designing a time-aware scalable learning paradigm as follows: 1) Time-aware Topology Reformulation: ScaDyG first segments historical interactions into time steps (intra and inter) based on dynamic modeling, enabling weight-free and time-aware graph propagation within pre-processing. 2) Dynamic Temporal Encoding: To further achieve fine-grained graph propagation within time steps, ScaDyG integrates temporal encoding through a combination of exponential functions in a scalable manner. 3) Hypernetwork-driven Message Aggregation: After obtaining the propagated features (i.e., messages), ScaDyG utilizes hypernetwork to analyze historical dependencies, implementing node-wise representation by an adaptive temporal fusion. Extensive experiments on 12 datasets demonstrate that ScaDyG performs comparably well or even outperforms other SOTA methods in both node and link-level downstream tasks, with fewer learnable parameters and higher efficiency.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。