提出可扩展的VARMA模型估计方法,实现长序列高效建模。
Scalable estimation of VARMA models
- 用偏自相关重参数化保证平稳性和可逆性,避免传统难题。
- 每轮优化成本与序列长度无关,支持 $d=10$ 到 $d=40$ 维数据。
- 适用于季节性、外生变量等场景,优于经典VAR和稀疏VARMA方法。
向量自回归移动平均(VARMA)模型长期被认为在高维下不实用:似然函数非凸,参数仅能识别到等价类,且每次评估需遍历全序列。但其移动平均项以少量参数捕捉纯自回归需大量滞后才能匹配的动态。本文提出新估计框架,使每轮优化计算成本独立于序列长度 $T$。该框架结合偏自相关重参数化(构造上保证平稳与可逆)、对角与非对角系数使用独立尺度的高斯先验,以及基于固定大小充分统计量的损失函数——通过Parseval恒等式近线性成本评估。由此得到两种点估计器:正则化最小二乘与协方差边际MAP估计。理论证明二者在固定维度下以近参数率恢复真实过程的无限阶自回归表示,截断无渐近偏差。相同机制还可拓展至季节性动态、外生回归变量(VARMAX)及滚动窗口重拟合,计算开销不变。实证显示,估计器在 $d=10$ 至 $d=40$ 维下接近最优预测误差,而传统条件MLE在 $d=40$ 时产生不可逆拟合并导致预测发散;其性能在零售需求、气象与空气质量数据上优于或匹敌VAR、贝叶斯VAR、分量式ARMA与稀疏VARMA基线。该方法将基于似然的VARMA估计推进至此前依赖VAR模型的大规模问题场景。
原文摘要 · Abstract (English)
Vector autoregressive moving-average (VARMA) models have long been considered impractical beyond moderate dimensions: the likelihood is non-convex, the parametrization is identified only up to equivalence, and every evaluation costs a pass over the entire series. Yet their moving-average term captures with a few parameters what a pure autoregression matches only with many lags. We introduce an estimation framework that removes this computational barrier: each optimization iteration is independent of the series length $T$. The framework combines a partial-autocorrelation reparametrization that guarantees stationarity and invertibility by construction, Gaussian priors on the reparametrized coefficients with separate scales for diagonal and off-diagonal entries, and losses that depend on the data only through fixed-size sufficient statistics, evaluated by a Parseval (Fourier) identity at near-linear cost in the truncation length. This yields two point estimators: a regularized least-squares fit and a covariance-marginalized maximum-a-posteriori estimator. We prove that both recover the infinite-autoregressive representation of the true process at a near-parametric rate in fixed dimension, so the truncation introduces no asymptotic bias. The same machinery extends, at the same leading cost, to seasonal dynamics, exogenous regressors (VARMAX), and rolling-window refits. Empirically, the estimators stay close to the oracle forecast error from $d=10$ to $d=40$ (where classical conditional MLE returns non-invertible fits whose forecasts diverge) and match or beat VAR, Bayesian-VAR, component-wise ARMA, and sparse-VARMA baselines on retail-demand, meteorological, and air-quality data. This brings likelihood-based VARMA estimation, at a per-iteration cost independent of the series length, to the problem sizes where practitioners have so far relied on VAR models.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。