Delphyne 是专为金融时序数据设计的预训练模型,性能优于现有方法。
DELPHYNE: A Pre-Trained Model for General and Financial Time Series
- 基于金融时序数据构建预训练模型,解决领域差异问题
- 在多个金融任务上表现超越基准模型,少样本微调即达高精度
- 适合金融时序分析、量化交易等需要高效建模的研究者
时序数据是数据科学中的关键模态,尤其在金融领域,可用于识别模式、理解市场行为并基于历史数据做出决策。近年来,语言建模的进步催生了大量时序预训练模型,这些模型在广泛数据集上训练,并应用于多样化的金融任务。然而,现有时序预训练模型在零样本和微调设置下,未表现出对简单金融基准的性能提升。这一现象源于:(i) 预训练阶段缺乏金融数据;(ii) 不同领域间时序模式本质差异导致负迁移。此外,时序数据具有连续性、噪声大、采样频率与变量滞后不一等特点,建模难度高于自然语言。为此,我们提出针对金融时序的预训练模型 Delphyne。该模型在公开数据集上仅需少量微调即可达到与现有基础模型及全量训练模型相当的性能,并在多种金融任务中展现出更优表现。
原文摘要 · Abstract (English)
Time-series data is a vital modality within data science communities. This is particularly valuable in financial applications, where it helps in detecting patterns, understanding market behavior, and making informed decisions based on historical data. Recent advances in language modeling have led to the rise of time-series pre-trained models that are trained on vast collections of datasets and applied to diverse tasks across financial domains. However, across financial applications, existing time-series pre-trained models have not shown boosts in performance over simple finance benchmarks in both zero-shot and fine-tuning settings. This phenomenon occurs because of a i) lack of financial data within the pre-training stage, and ii) the negative transfer effect due to inherently different time-series patterns across domains. Furthermore, time-series data is continuous, noisy, and can be collected at varying frequencies and with varying lags across different variables, making this data more challenging to model than languages. To address the above problems, we introduce a Pre-trained MoDEL for FINance TimE-series (Delphyne). Delphyne achieves competitive performance to existing foundation and full-shot models with few fine-tuning steps on publicly available datasets, and also shows superior performances on various financial tasks.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。