通过重建当前值与预测未来值,高效学习时空数据表示。
ST-ReP: Learning Predictive Representations Efficiently for Spatial-Temporal Forecasting
- 融合当前值重建与未来值预测的自监督框架
- 多时间尺度损失提升预测能力,优于现有基线模型
- 轻量级设计适合大规模时空数据,可扩展性强
时空预测在交通、能源、气候等领域具有广泛应用。得益于大量未标注的时空数据,自监督方法逐渐被用于学习时空表征。然而,现有方法面临三大挑战:1)变量同质性导致负样本难以选取,制约对比学习效果;2)忽视变量间随时间变化的空间相关性;3)现有自监督方法效率与可扩展性不足。为此,本文提出轻量级模型ST-ReP,将当前值重建与未来值预测融入预训练框架,并设计新型时空编码器以建模细粒度关系。同时,引入多时间尺度分析增强自监督损失的预测能力。跨多个领域的实验表明,该模型优于基于预训练的基线方法,在学习紧凑且语义丰富的表示方面表现优异,且具备更强的可扩展性。
原文摘要 · Abstract (English)
Spatial-temporal forecasting is crucial and widely applicable in various domains such as traffic, energy, and climate. Benefiting from the abundance of unlabeled spatial-temporal data, self-supervised methods are increasingly adapted to learn spatial-temporal representations. However, it encounters three key challenges: 1) the difficulty in selecting reliable negative pairs due to the homogeneity of variables, hindering contrastive learning methods; 2) overlooking spatial correlations across variables over time; 3) limitations of efficiency and scalability in existing self-supervised learning methods. To tackle these, we propose a lightweight representation-learning model ST-ReP, integrating current value reconstruction and future value prediction into the pre-training framework for spatial-temporal forecasting. And we design a new spatial-temporal encoder to model fine-grained relationships. Moreover, multi-time scale analysis is incorporated into the self-supervised loss to enhance predictive capability. Experimental results across diverse domains demonstrate that the proposed model surpasses pre-training-based baselines, showcasing its ability to learn compact and semantically enriched representations while exhibiting superior scalability.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。