不修改模型权重,用轻量包装器提升时间序列大模型的干旱预测能力
Lightweight Wrappers for Adapting Time Series Foundation Models to Regional Drought Forecasting

- 引入两个可插拔包装器,在推理时通过多分辨率残差和块重采样生成多样预测
- 在南澳多个站点实现最高26%的均方误差降低,且无需微调骨干模型
- 适合算力有限、数据少的区域气候预测场景,部署成本极低
大型时间序列基础模型(TSFMs)在跨领域零样本预测中表现优异,但在区域气候预测中面临实际挑战:模型权重常为私有,本地训练数据有限,计算资源受限,传统微调方法难以应用。为此,我们提出一种轻量级、黑箱式适配框架(无需访问主干参数,也不需微调主干模型),在推理时通过两个即插即用的包装器增强冻结的TSFMs:SMR²(稳态感知多分辨率残差),将输入分解为多分辨率时间视图,学习步长相关的残差修正以捕捉区域动态,再自适应融合为单一预测;MBB(移动块重采样),通过块重采样保留时间依赖性,并对时间连贯的残差扰动进行集成,稳定点预测。两者均基于集成学习思想:构建输入或其残差的多样化视图,用同一冻结主干分别预测后聚合,所有适配均来自推理阶段集成,无任何权重更新。在南澳多个站点进行一个月提前期标准降水蒸散指数(SPEI)预测评估,该框架在多个主干模型上均显著提升性能,相比对应冻结主干模型最高实现26%的均方误差(MSE)降低,同时支持资源受限区域预测系统的实用部署。
原文摘要 · Abstract (English)
Large \emph{Time Series Foundation Models} (TSFMs) demonstrate strong zero-shot forecasting capabilities across diverse domains. However, their application to regional climate forecasting faces practical challenges: model weights are often proprietary, local training records are limited, and computational budgets are constrained, making traditional fine-tuning approaches infeasible. To address these constraints, we introduce a lightweight, black-box adaptation framework (requiring no access to backbone parameters and no backbone fine-tuning) that enhances frozen TSFMs at inference time through two plug-and-play wrappers: \textbf{SMR\textsuperscript{2}} (Stationarity aware multi-resolution Residual), which decomposes the input into multi-resolution temporal views, learns stride specific residual corrections that capture regional dynamics, then adaptively ensembles them into a single forecast, and \textbf{MBB} (Moving Block Bootstrap), which preserves temporal dependencies through block resampling and ensembles over temporally coherent residual perturbations to stabilize the point forecast. Both wrappers instantiate the same bagging style principle: they build diverse views of the input or its residuals, forecast each with the same frozen backbone, and aggregate, so all adaptation comes from inference time ensembling rather than any weight update. Evaluated on one month ahead Standardized Precipitation Evapotranspiration Index (SPEI) prediction across multiple sites in South Australia, our framework consistently improves forecasting performance across several backbone models, demonstrating up to 26\% mean squared error (MSE) reduction over the corresponding frozen backbone while enabling practical deployment in resource constrained regional forecasting systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。