针对动态图边分类,提出角色分离的不对称预训练方法。
DyGnROLE: Asymmetric Pretraining for Edge Classification on Dynamic Graphs
- 用独立嵌入表和角色位置编码区分源节点与目标节点表示。
- 在标签稀缺场景下,通过方向角色对齐提升分类准确率。
- 适合处理有向动态图中角色差异明显的边分类任务。
有向动态图中的边分类需建模源节点与目标节点之间不对称的行为模式和时间动态性。然而,现有动态图架构大多对源节点和目标节点使用共享参数,缺乏系统性的角色感知建模。本文提出 DyGnROLE(动态图节点角色导向潜在编码),一种基于 Transformer 的架构,将源节点与目标节点的表示解耦。通过使用独立的嵌入表和角色语义位置编码,模型捕捉每种角色独有的结构与时间上下文。在标签稀疏场景(常见于边分类)中,引入自监督预训练目标:方向角色对齐(DRA)。DRA 通过训练源表示检索其对应的目标表示,并采用历史正样本掩码策略,排除先前观测到的交互用于未来负样本对比。掩码机制引入了时间方向性的训练信号,使得节点对单调地从未见状态过渡到已见状态,之后才可进行进一步对齐。在八个数据集上的四个边分类任务的综合评估表明,DyGnROLE 持续优于多种先进基线,凸显角色感知表示学习与不对称预训练在标签有限条件下建模复杂有向交互的重要性。
原文摘要 · Abstract (English)
Edge classification on directed dynamic graphs requires modeling interactions between source and destination nodes exhibiting asymmetrical behavioral patterns and temporal dynamics. However, existing dynamic graph architectures largely rely on shared parameters for processing source and destination nodes, with limited or no systematic role-aware modeling. We propose DyGnROLE (Dynamic Graph Node-Role-Oriented Latent Encoding), a Transformer-based architecture that disentangles source and destination representations. By using separate embedding tables and role-semantic positional encodings, the model captures the distinct structural and temporal contexts unique to each role. Critical in limited-label settings, which are common in edge classification, is a self-supervised pretraining objective we introduce: Directional Role Alignment (DRA). DRA learns distinct but aligned source and destination embedding spaces by training source representations to retrieve their corresponding destination representations while a historical positive masking strategy excludes previously observed interactions from future negative comparisons. The masks introduce a temporally directional training signal in which node pairs progress monotonically from unseen to observed, after which the relationship is eligible only for further alignment. A comprehensive evaluation on four edge classification tasks across eight datasets demonstrates that DyGnROLE consistently outperforms a wide range of state-of-the-art baselines, highlighting the importance of role-aware representation learning and asymmetric pretraining for modeling complex directed interactions when labeled data is limited.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。