提出双分支时空自监督框架,提升道路网络表征能力
Dual-branch Spatial-Temporal Self-supervised Representation for Enhanced Road Network Learning
- 设计混合跳数转移矩阵捕捉动态道路关系
- 超图对比与因果Transformer使表征更精准,零样本任务表现优
- 适合道路网络建模、交通预测等场景
道路网络表示学习(RNRL)因各类时空任务兴起而备受关注。现有方法多采用图神经网络(GNN)与对比学习实现自监督表征,但道路网络的空间异质性与时间动态性对自监督GNN的邻域平滑机制构成挑战。为此,本文提出双分支时空自监督框架DST:一方面,设计混合跳数转移矩阵,融合轨迹数据中的动态道路关系;同时构建基于三类超边的超图,通过空间对比学习捕捉长程关联;另一方面,在交通动态序列上使用因果Transformer进行下一步节点预测,并区分工作日与周末交通模式以增强正则化。大量实验表明,该框架优于现有先进方法,且在零样本学习场景中表现突出。
原文摘要 · Abstract (English)
Road network representation learning (RNRL) has attracted increasing attention from both researchers and practitioners as various spatiotemporal tasks are emerging. Recent advanced methods leverage Graph Neural Networks (GNNs) and contrastive learning to characterize the spatial structure of road segments in a self-supervised paradigm. However, spatial heterogeneity and temporal dynamics of road networks raise severe challenges to the neighborhood smoothing mechanism of self-supervised GNNs. To address these issues, we propose a $\textbf{D}$ual-branch $\textbf{S}$patial-$\textbf{T}$emporal self-supervised representation framework for enhanced road representations, termed as DST. On one hand, DST designs a mix-hop transition matrix for graph convolution to incorporate dynamic relations of roads from trajectories. Besides, DST contrasts road representations of the vanilla road network against that of the hypergraph in a spatial self-supervised way. The hypergraph is newly built based on three types of hyperedges to capture long-range relations. On the other hand, DST performs next token prediction as the temporal self-supervised task on the sequences of traffic dynamics based on a causal Transformer, which is further regularized by differentiating traffic modes of weekdays from those of weekends. Extensive experiments against state-of-the-art methods verify the superiority of our proposed framework. Moreover, the comprehensive spatiotemporal modeling facilitates DST to excel in zero-shot learning scenarios.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。