提出新型二次加权训练法,提升多步时间序列预测精度
Quadratic Direct Forecast for Training Multi-Step Time-Series Forecast Models
- 用二次形式加权矩阵同时处理未来步长相关性与任务差异性
- 在多个数据集上超越现有方法,实现最新性能
- 适合需要高精度多步预测的工业场景应用
时间序列预测模型的训练目标设计至关重要。现有方法如均方误差通常将每个未来步骤视为独立且权重相同的任务,这导致两个问题:(1) 忽视未来步长间的标签自相关效应,造成训练目标偏差;(2) 未为不同未来步长设置差异化任务权重,限制了预测性能。为此,我们提出一种新型二次形式加权训练目标,同时解决上述问题:加权矩阵的非对角元素捕捉标签自相关效应,非均匀对角元素则匹配各未来步长最适任务权重。我们进一步提出二次直接预测(QDF)学习算法,通过自适应更新的二次形式加权矩阵训练模型。实验表明,QDF能有效提升多种预测模型的性能,达到当前最优结果。代码已公开于 https://anonymous.4open.science/r/QDF-8937。
原文摘要 · Abstract (English)
The design of training objective is central to training time-series forecasting models. Existing training objectives such as mean squared error mostly treat each future step as an independent, equally weighted task, which we found leading to the following two issues: (1) overlook the label autocorrelation effect among future steps, leading to biased training objective; (2) fail to set heterogeneous task weights for different forecasting tasks corresponding to varying future steps, limiting the forecasting performance. To fill this gap, we propose a novel quadratic-form weighted training objective, addressing both of the issues simultaneously. Specifically, the off-diagonal elements of the weighting matrix account for the label autocorrelation effect, whereas the non-uniform diagonals are expected to match the most preferable weights of the forecasting tasks with varying future steps. To achieve this, we propose a Quadratic Direct Forecast (QDF) learning algorithm, which trains the forecast model using the adaptively updated quadratic-form weighting matrix. Experiments show that our QDF effectively improves performance of various forecast models, achieving state-of-the-art results. Code is available at https://anonymous.4open.science/r/QDF-8937.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。