对比Transformer与xLSTM在建筑级供热需求预测中的表现,发现xLSTM更准但耗能高。
Benchmarking Transformer and xLSTM for Time-Series Forecasting of Heat Consumption

- 用25栋德国建筑的小时级数据,对比xLSTM与Transformer在3小时和24小时预测效果
- xLSTM RMSE最低(3小时19.88 kWh,24小时21.47 kWh),TFT MAE最优(3小时9.16 kWh)
- 低参数模型也能达到良好效果,提示新模型精度提升代价过大
准确的短期供热需求预测是实现区域供热网络低成本、可靠运行的关键。建筑层面的供热时间序列高度依赖室外温度等外部变量和个体使用模式,使得该场景下的预测极具挑战性。本文针对短时供热需求预测,对比了新型基于Transformer和xLSTM的架构。基于2017–2025年德国25栋建筑的小时级数据,评估了适用于日内调控和日前调度的3小时与24小时预测时序。建立多建筑基准,检验在异构建筑数据上训练的模型是否具备跨建筑泛化能力。结果表明,xLSTM在3小时和24小时预测中均取得最低RMSE(分别为19.88 kWh、21.47 kWh),而时序融合变压器(Temporal Fusion Transformer)在3小时预测中达到最佳MAE(9.16 kWh)。然而,xLSTM与Transformer需长时间训练且参数量巨大,其可持续性存疑。因此,本文进一步分析了预测精度与计算资源消耗之间的权衡。研究发现,如全连接网络这类低参数模型同样可获得良好预测性能,提示在该任务中,新模型带来的边际精度提升需付出巨大资源代价。
原文摘要 · Abstract (English)
Obtaining an accurate short-term forecasting for heat demand is an essential part of operating district heating networks cost-efficient and reliable. Heat consumption time series at the building level are highly dependent on exogenous variables such as outdoor temperature and individual usage patterns, making forecasting in this context a challenging task. Thus, this paper benchmarks novel Transformer-based and xLSTM architectures for short-term heat-demand forecasting. Using hourly data from 25 German buildings (2017-2025), we compare three-hour and 24-hour forecasting horizons relevant for intraday control and day-ahead scheduling. We establish a multi-building benchmark that tests whether models trained on pooled, heterogeneous building data are able to generalize across diverse building stock. The results show that the xLSTM achieves the lowest RMSE (19.88 kWh for three-hour, 21.47 kWh for 24-hour forecasts), while the Temporal Fusion Transformer attains the best MAE (9.16 kWh for three-hour forecasts). As xLSTMs and Transformers require long training times and have a huge number of trainable parameters, their sustainability remains questionable. Therefore, this paper further investigates the trade-off between predictive accuracy and computational resource demand of the evaluated forecasting models. The findings indicate that also low-parameter models like a traditional fully-connected network achieve good predictive results, highlighting that marginal accuracy gains of the novel prediction models come at substantial resource expense for this use case.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。