arXiv:2503.10873stat.MLcs.LG2025-03被引 13

给Mamba模型加不确定性量化,让预测更可信。

Mamba time series forecasting with uncertainty quantification

  • 双网络架构:一个算点预测,一个估误差范围。
  • 真实数据中95%的轨迹落在两倍标准差区间内。
  • 适合需要可靠置信区间的电力、交通等场景。

状态空间模型(如Mamba)在时间序列预测中因能捕捉序列模式而受到关注。然而,在电力消耗基准上,Mamba预测的平均误差约为8%;在交通占用率基准上,平均误差高达18%。这种差异让人难以判断是预测不准,还是本就存在历史数据的波动。为此,我们提出一种量化Mamba预测不确定性的方法。设计基于Mamba架构的双网络框架,实现概率预测:一个网络输出点预测,另一个建模方差以估计不确定性。该工具命名为Mamba-ProbTSF,代码已开源。在合成与真实世界基准数据集上评估,学习分布与真实数据之间的Kullback-Leibler散度,在合成数据中降至约10⁻³,真实数据中为10⁻¹,证明其有效性。在电力与交通基准中,真实轨迹在两倍标准差的预测区间内出现约95%的时间。最后讨论了潜在局限及对纯随机过程(如布朗运动)的应用前景。

原文摘要 · Abstract (English)

State space models, such as Mamba, have recently garnered attention in time series forecasting due to their ability to capture sequence patterns. However, in electricity consumption benchmarks, Mamba forecasts exhibit a mean error of approximately 8\%. Similarly, in traffic occupancy benchmarks, the mean error reaches 18\%. This discrepancy leaves us to wonder whether the prediction is simply inaccurate or falls within error given spread in historical data. To address this limitation, we propose a method to quantify the predictive uncertainty of Mamba forecasts. Here, we propose a dual-network framework based on the Mamba architecture for probabilistic forecasting, where one network generates point forecasts while the other estimates predictive uncertainty by modeling variance. We abbreviate our tool, Mamba with probabilistic time series forecasting, as Mamba-ProbTSF and the code for its implementation is available on GitHub (https://github.com/PessoaP/Mamba-ProbTSF). Evaluating this approach on synthetic and real-world benchmark datasets, we find Kullback-Leibler divergence between the learned distributions and the data--which, in the limit of infinite data, should converge to zero if the model correctly captures the underlying probability distribution--reduced to the order of $10^{-3}$ for synthetic data and $10^{-1}$ for real-world benchmark, demonstrating its effectiveness. We find that in both the electricity consumption and traffic occupancy benchmark, the true trajectory stays within the predicted uncertainty interval at the two-sigma level about 95\% of the time. We end with a consideration of potential limitations, adjustments to improve performance, and considerations for applying this framework to processes for purely or largely stochastic dynamics where the stochastic changes accumulate, as observed for example in pure Brownian motion or molecular dynamics trajectories.

时间序列不确定性Mamba

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。