让预测模型同时学习输入与目标的差异,提升时空预测准确性
A General ReLearner: Empowering Spatiotemporal Prediction by Re-learning Input-label Residual
- 引入双向学习框架,显式建模输入与标签间的残差特征
- 在11个真实数据集上,14种模型均显著提升预测效果
- 适合需要高精度时空预测的场景,如交通、气象建模
主流时空预测模型多采用单向学习范式,从历史输入中提取特征并映射到未来目标空间进行预测。然而当输入与标签存在时空差异时(如相似时间序列对应不同未来状态),性能往往不佳。为此,本文提出显式在训练阶段引入标签特征,基于时空残差定理,将传统单向预测扩展为双向学习框架。在此基础上,设计通用模块ReLearner,通过辅助逆向学习过程,重新学习输入与未来数据之间的时空特征残差。ReLearner包含两个核心组件:残差学习模块,用于解耦输入与标签表示间的特征差异;残差平滑模块,用于平滑残差项,促进稳定收敛。在11个真实世界数据集、14种骨干模型上的大量实验表明,ReLearner能显著提升现有时空神经网络的预测性能。代码已开源。
原文摘要 · Abstract (English)
Prevailing spatiotemporal prediction models typically operate under a forward (unidirectional) learning paradigm, in which models extract spatiotemporal features from historical observation input and map them to target spatiotemporal space for future forecasting (label). However, these models frequently exhibit suboptimal performance when spatiotemporal discrepancies exist between inputs and labels, for instance, when nodes with similar time-series inputs manifest distinct future labels, or vice versa. To address this limitation, we propose explicitly incorporating label features during the training phase. Specifically, we introduce the Spatiotemporal Residual Theorem, which generalizes the conventional unidirectional spatiotemporal prediction paradigm into a bidirectional learning framework. Building upon this theoretical foundation, we design an universal module, termed ReLearner, which seamlessly augments Spatiotemporal Neural Networks (STNNs) with a bidirectional learning capability via an auxiliary inverse learning process. In this process, the model relearns the spatiotemporal feature residuals between input data and future data. The proposed ReLearner comprises two critical components: (1) a Residual Learning Module, designed to effectively disentangle spatiotemporal feature discrepancies between input and label representations; and (2) a Residual Smoothing Module, employed to smooth residual terms and facilitate stable convergence. Extensive experiments conducted on 11 real-world datasets across 14 backbone models demonstrate that ReLearner significantly enhances the predictive performance of existing STNNs.Our code is available on GitHub.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。