用预训练时序模型提升金融数据少时的预测能力。
Time Series Foundation Models for Multivariate Financial Time Series Forecasting
- 用大规模时序数据预训练模型,再微调至金融任务
- 预训练模型在少数据下性能提升25%-50%,少需3-10年数据
- 适合数据稀疏的金融场景,如新上市资产或新兴市场
金融时间序列预测面临非线性关系复杂、依赖性强、变量间关联多且数据有限等挑战,尤其在低频数据、新上市资产或新兴市场资产任务中更为突出。时序基础模型(TSFMs)通过在多样化时序数据上预训练,再进行任务微调,提供了可行方案。本研究评估了两种TSFM(Tiny Time Mixers (TTM) 和 Chronos)在三个金融预测任务中的表现:美国10年期国债收益率变化、欧元/美元波动率、股票利差预测。结果表明,TTM具备强迁移能力:在有限数据上微调时,预训练版本性能比同架构未训练模型高25%-50%;在更长数据集上也提升15%-30%。值得注意的是,TTM零样本表现已优于简单基准,在波动率和利差预测中甚至无需微调即超越传统模型。预训练模型达成同等效果所需数据量比未训练模型少3-10年,体现显著样本效率优势。然而,尽管优于基线,传统专用模型在其中两项任务中仍持平或超越其表现,表明当前TSFMs更侧重广度而非任务特化。研究显示,虽尚处初期,但TSFMs在噪声大、数据少的金融预测中潜力巨大,实现竞争力需针对性预训练与结构优化。
原文摘要 · Abstract (English)
Financial time series forecasting presents significant challenges due to complex nonlinear relationships, temporal dependencies, variable interdependencies and limited data availability, particularly for tasks involving low-frequency data, newly listed instruments, or emerging market assets. Time Series Foundation Models (TSFMs) offer a promising solution through pretraining on diverse time series corpora followed by task-specific adaptation. This study evaluates two TSFMs (Tiny Time Mixers (TTM) and Chronos) across three financial forecasting tasks: US 10-year Treasury yield changes, EUR/USD volatility, and equity spread prediction. Results demonstrate that TTM exhibits strong transferability. When fine-tuning both the pretrained version of TTM and an untrained model with the same architecture, the pretrained version achieved 25-50% better performance when fine-tuned on limited data and 15-30% improvements even when fine-tuned on lengthier datasets. Notably, TTM's zero-shot performance outperformed naive benchmarks in volatility forecasting and equity spread prediction, with the latter demonstrating that TSFMs can surpass traditional benchmark models without fine-tuning. The pretrained model consistently required 3-10 fewer years of data to achieve comparable performance levels compared to the untrained model, demonstrating significant sample-efficiency gains. However, while TTM outperformed naive baselines, traditional specialised models matched or exceeded its performance in two of three tasks, suggesting TSFMs prioritise breadth over task-specific optimisation. These findings indicate that TSFMs, though still nascent, offer substantial promise for financial forecasting-particularly in noisy, data-constrained tasks-but achieving competitive performance likely requires domain-specific pretraining and architectural refinements tailored to financial time series characteristics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。