arXiv:2412.20810cs.LG2024-12被引 24

用检索增强提升零样本时间序列预测能力

TimeRAF: Retrieval-Augmented Foundation model for Zero-shot Time Series Forecasting

  • 构建专用时间序列知识库,通过可学习检索器提取相关知识
  • 在多个数据集上实现显著性能提升,支持零样本预测
  • 适合需要快速适配新场景的时间序列分析任务

时间序列预测在数据挖掘中至关重要,推动了众多行业的快速发展。随着大模型的兴起,时间序列基础模型(TSFMs)通过大规模预训练展现出强大的泛化能力,如零样本学习。同时,检索增强生成(RAG)方法被广泛用于提升基础模型在未见数据上的表现,使模型能够访问外部知识。本文提出TimeRAF,一种基于检索增强的时间序列预测模型,通过检索增强技术提升零样本时间序列预测能力。我们构建了针对特定预测任务定制的时间序列知识库,采用端到端可学习的检索器从知识库中提取有价值信息。此外,提出通道提示(Channel Prompting)机制,有效沿通道维度提取检索到的知识。大量实验表明,该模型在多个领域和数据集上均表现出显著性能提升。

原文摘要 · Abstract (English)

Time series forecasting plays a crucial role in data mining, driving rapid advancements across numerous industries. With the emergence of large models, time series foundation models (TSFMs) have exhibited remarkable generalization capabilities, such as zero-shot learning, through large-scale pre-training. Meanwhile, Retrieval-Augmented Generation (RAG) methods have been widely employed to enhance the performance of foundation models on unseen data, allowing models to access to external knowledge. In this paper, we introduce TimeRAF, a Retrieval-Augmented Forecasting model that enhance zero-shot time series forecasting through retrieval-augmented techniques. We develop customized time series knowledge bases that are tailored to the specific forecasting tasks. TimeRAF employs an end-to-end learnable retriever to extract valuable information from the knowledge base. Additionally, we propose Channel Prompting for knowledge integration, which effectively extracts relevant information from the retrieved knowledge along the channel dimension. Extensive experiments demonstrate the effectiveness of our model, showing significant improvement across various domains and datasets.

时间序列检索增强零样本

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。