通过因果去混淆构建时空表示,提升人群流动预测精度
STDCformer: A Transformer-Based Model with a Spatial-Temporal Causal De-Confounding Strategy for Crowd Flow Prediction
- 提出时空后门调整策略,学习去混淆的时空表征空间
- 设计跨时间注意力机制,实现过去到未来的精准映射
- 适合关注城市交通与人流预测的研究者和工程师
现有方法通常将时空预测视为从历史观测映射到未来观测的函数学习问题。本文将其分解为三个过程:(1) 编码(E):学习观测的内在表示;(2) 跨时间映射(M):将过去表示转换为未来表示;(3) 解码(D):从未来表示重构未来观测。由此,时空预测可建模为 $F = E \cdot M \cdot D$,包含观测空间与隐藏表示空间间的空间变换 $\{E, D\}$,以及表示空间内从未来状态到过去状态的时空映射 $M$。针对两个核心问题:(Q1) 哪种表示空间支持过去到未来的映射?(Q2) 如何在表示空间中实现该映射?为解决 Q1,提出时空后门调整策略,学习时空去混淆(STDC)表示空间,并估计历史数据对未来的去混杂因果效应,作为后续映射的基础。为解决 Q2,设计时空嵌入(STE),融合时间与空间混杂因子信息,捕捉表示的内在时空特性,并引入跨时间注意力机制,通过未来与过去之间的注意力查询引导时空映射。
原文摘要 · Abstract (English)
Existing works typically treat spatial-temporal prediction as the task of learning a function $F$ to transform historical observations to future observations. We further decompose this cross-time transformation into three processes: (1) Encoding ($E$): learning the intrinsic representation of observations, (2) Cross-Time Mapping ($M$): transforming past representations into future representations, and (3) Decoding ($D$): reconstructing future observations from the future representations. From this perspective, spatial-temporal prediction can be viewed as learning $F = E \cdot M \cdot D$, which includes learning the space transformations $\left\{{E},{D}\right\}$ between the observation space and the hidden representation space, as well as the spatial-temporal mapping $M$ from future states to past states within the representation space. This leads to two key questions: \textbf{Q1: What kind of representation space allows for mapping the past to the future? Q2: How to achieve map the past to the future within the representation space?} To address Q1, we propose a Spatial-Temporal Backdoor Adjustment strategy, which learns a Spatial-Temporal De-Confounded (STDC) representation space and estimates the de-confounding causal effect of historical data on future data. This causal relationship we captured serves as the foundation for subsequent spatial-temporal mapping. To address Q2, we design a Spatial-Temporal Embedding (STE) that fuses the information of temporal and spatial confounders, capturing the intrinsic spatial-temporal characteristics of the representations. Additionally, we introduce a Cross-Time Attention mechanism, which queries the attention between the future and the past to guide spatial-temporal mapping.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。