用检索增强让时序大模型在异常检测中不需微调也能表现好
RATFM: Retrieval-augmented Time Series Foundation Model for Anomaly Detection
- 通过检索相似样本,让预训练时序模型在测试时动态适应新任务
- 在9个不同领域的数据集上达到与微调相当的异常检测精度
- 适合需要快速适配新场景且无法重新训练的工业异常检测应用
受大语言模型在自然语言处理中成功启发,近期研究尝试构建时序基础模型并应用于预测、分类和异常检测等任务。然而,其性能在不同领域和任务间差异显著。在基于大语言模型的方法中,由于重训练成本高,测试时使用示例提示进行自适应已成为常态。在本研究聚焦的异常检测任务中,提供目标领域的正常样本同样有效。然而,时序基础模型在训练过程中并未自然获得解释或利用示例或指令的能力,因为训练数据的性质未促进此类能力。为此,我们提出检索增强型时序基础模型(RATFM),使预训练时序基础模型能够结合测试时的示例进行自适应。实验表明,RATFM在无需领域专属微调的情况下,性能可媲美域内微调。在包含九个领域的UCR异常档案数据集上的实验验证了该方法的有效性。
原文摘要 · Abstract (English)
Inspired by the success of large language models (LLMs) in natural language processing, recent research has explored the building of time series foundation models and applied them to tasks such as forecasting, classification, and anomaly detection. However, their performances vary between different domains and tasks. In LLM-based approaches, test-time adaptation using example-based prompting has become common, owing to the high cost of retraining. In the context of anomaly detection, which is the focus of this study, providing normal examples from the target domain can also be effective. However, time series foundation models do not naturally acquire the ability to interpret or utilize examples or instructions, because the nature of time series data used during training does not encourage such capabilities. To address this limitation, we propose a retrieval augmented time series foundation model (RATFM), which enables pretrained time series foundation models to incorporate examples of test-time adaptation. We show that RATFM achieves a performance comparable to that of in-domain fine-tuning while avoiding domain-dependent fine-tuning. Experiments on the UCR Anomaly Archive, a multi-domain dataset including nine domains, confirms the effectiveness of the proposed approach.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。