提出MoMent模型,融合时间、文本与结构三模态信息提升动态图链接预测性能。
Unlocking Multi-Modal Potentials for Link Prediction on Dynamic Text-Attributed Graphs
- 分三路编码时间、文本与结构模态,分别提取特征并融合
- 在7个数据集上最高提升17.28%准确率,速度提升31倍
- 适合做动态图分析、多模态表征学习的研究者参考
动态文本属性图(DyTAGs)是一种新型图范式,能够捕捉随时间演化的事件(边)及丰富的文本属性。现有方法可分为基于TGNN和基于LLM的两类,均对文本属性与时间结构进行编码以学习表征。我们观察到,DyTAGs本质上包含时间、文本与结构三种独立分布的模态,但当前研究大多忽视前两者,导致性能不佳。为此,我们提出MoMent,一种显式建模、融合与对齐各模态的多模态模型,用于节点表征学习以实现链接预测。针对原始模态分布完全分离的问题,我们首先构建模态特定特征,并通过独立编码器捕获时间模式、语义上下文与局部结构的相关性。每个编码器生成模态特定的令牌,随后通过具有理论保障的方式融合为综合节点表征。为避免异构模态间子空间分离,我们设计双域对齐损失:先全局对齐分布,再在实例层面精细化调和一致性,从而增强来自时间、文本与结构视角的一致表征。在七个数据集上的大量实验表明,MoMent相较八种基线模型最高提升17.28%准确率,速度提升高达31倍。
原文摘要 · Abstract (English)
Dynamic Text-Attributed Graphs (DyTAGs) are a novel graph paradigm that captures evolving temporal events (edges) alongside rich textual attributes. Existing studies can be broadly categorized into TGNN-driven and LLM-driven approaches, both of which encode textual attributes and temporal structures for DyTAG representation. We observe that DyTAGs inherently comprise three distinct modalities: temporal, textual, and structural, often exhibiting completely disjoint distributions. However, the first two modalities are largely overlooked by existing studies, leading to suboptimal performance. To address this, we propose MoMent, a multi-modal model that explicitly models, integrates, and aligns each modality to learn node representations for link prediction. Given the disjoint nature of the original modality distributions, we first construct modality-specific features and encode them using individual encoders to capture correlations across temporal patterns, semantic context, and local structures. Each encoder generates modality-specific tokens, which are then fused into comprehensive node representations with a theoretical guarantee. To avoid disjoint subspaces of these heterogeneous modalities, we propose a dual-domain alignment loss that first aligns their distributions globally and then fine-tunes coherence at the instance level. This enhances coherent representations from temporal, textual, and structural views. Extensive experiments across seven datasets show that MoMent achieves up to 17.28% accuracy improvement and up to 31x speed-up against eight baselines.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。