2DXformer通过分离变量类型提升风电预测精度。
2DXformer: Dual Transformers for Wind Power Forecasting with Dual Exogenous Variables
- 区分静态/动态外生变量与内生变量,分别建模
- 在两个真实大规模数据集上均优于现有方法
- 适合电力系统调度与可再生能源研究者
精准的风电功率预测有助于制定科学的调度计划,对保障电力系统安全、稳定和高效运行具有重要意义。近年来,基于深度学习的风电预测方法聚焦于捕捉数据间的时空相关性,显著提升了预测精度。然而,现有方法存在两大局限:一是缺乏对变量间关系的建模,限制了预测准确性;二是将内生与外生变量同等处理,导致不必要的交互,增加模型复杂度。本文提出2DXformer,基于前人对时空相关性的关注,解决上述问题。具体而言,将模型输入分为三类:外生静态变量、外生动态变量和内生变量。首先以通道无关方式将这些变量嵌入为变量令牌;然后利用注意力机制捕捉外生变量间的相关性;最后通过带残差连接的多层感知机建模外生变量对内生变量的影响。在两个真实世界大规模数据集上的实验结果表明,所提出的2DXformer能进一步提升风电预测性能。代码已公开于:https://github.com/jseaj/2DXformer。
原文摘要 · Abstract (English)
Accurate wind power forecasting can help formulate scientific dispatch plans, which is of great significance for maintaining the safety, stability, and efficient operation of the power system. In recent years, wind power forecasting methods based on deep learning have focused on extracting the spatiotemporal correlations among data, achieving significant improvements in forecasting accuracy. However, they exhibit two limitations. First, there is a lack of modeling for the inter-variable relationships, which limits the accuracy of the forecasts. Second, by treating endogenous and exogenous variables equally, it leads to unnecessary interactions between the endogenous and exogenous variables, increasing the complexity of the model. In this paper, we propose the 2DXformer, which, building upon the previous work's focus on spatiotemporal correlations, addresses the aforementioned two limitations. Specifically, we classify the inputs of the model into three types: exogenous static variables, exogenous dynamic variables, and endogenous variables. First, we embed these variables as variable tokens in a channel-independent manner. Then, we use the attention mechanism to capture the correlations among exogenous variables. Finally, we employ a multi-layer perceptron with residual connections to model the impact of exogenous variables on endogenous variables. Experimental results on two real-world large-scale datasets indicate that our proposed 2DXformer can further improve the performance of wind power forecasting. The code is available in this repository: \href{https://github.com/jseaj/2DXformer}{https://github.com/jseaj/2DXformer}.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。