用预训练模型零样本检测多变量时间序列异常,发现其对持续异常不敏感但能捕捉突变点。
Exploring Zero-Shot Foundation Models for Multivariate Time Series Anomaly Detection

- 将单变量预测模型作为每个特征的独立预测器或嵌入器,尝试零样本应用
- 模型在异常段内误差低,导致正常与异常难以区分,但边界处误差显著上升
- 虽不适合作为通用异常检测器,但可有效定位异常发生的时间点
多变量时间序列异常检测(MTSAD)对工业过程监控和金融风险控制至关重要,但传统方法依赖特定任务模型,训练成本高且难扩展。近期出现的单变量时间序列预训练基础模型(TimesFM)引发疑问:能否无需微调直接用于MTSAD?我们在安全水务处理(SWaT)基准上评估两种策略:将模型作为各特征的预测器,通过预测误差阈值判断异常;或将中间表示作为嵌入,输入标准离群检测器。结果表明,两种方法均不及现有基线,嵌入仅呈现部分正常与异常段分离,不足以实现可靠检测。根本原因在于模型过强的时序建模能力,在完全异常窗口内仍保持低误差,使持续异常与正常行为混淆。然而,我们发现异常边界处误差显著升高,说明基础模型能可靠识别分布变化。结论:当前简单零样本应用的基础模型不适合MTSAD,但适用于变化点检测。
原文摘要 · Abstract (English)
Multivariate Time Series Anomaly Detection (MTSAD) is essential for reliability and safety in domains such as industrial process monitoring and financial risk management, yet conventional approaches rely on application-specific models that are costly to train and hard to scale. Foundation Models (FMs), pre-trained on broad data with strong zero-shot generalization, have recently become available for univariate time series forecasting, raising the question of whether they can address MTSAD without task-specific training. We investigate the zero-shot application of a univariate forecasting FM, TimesFM, to industrial MTSAD on the Secure Water Treatment (SWaT) benchmark, evaluating two strategies: treating the FM as a per-feature forecaster with thresholded prediction errors, and as an embedder whose intermediate representations feed standard outlier detectors. Neither of our proposed setups is competitive with established baselines; embeddings reveal only partial separation between normal and anomalous segments, insufficient for reliable detection. The cause is that the FM is too effective at capturing temporal dynamics, yielding low error even within fully anomalous windows, so persistent anomalies become indistinguishable from normal behavior. However, these observations yield valuable insights: the error peaks at anomaly boundaries, indicating FMs reliably detect distribution changes. We conclude that the proposed naive zero-shot FMs are unsuitable for MTSAD but promising for change-point detection.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。