arXiv:2502.17812cs.CLcs.LG2025-02被引 23

用多模态大模型做时间序列异常检测,能自动推理并自检。

Can Multimodal LLMs Perform Time Series Anomaly Detection?

  • 设计多智能体框架,分步协同完成异常检测
  • 在点、区间、变量子粒度上均实现零样本检测
  • 支持不规则采样,适合真实系统监控场景

时间序列异常检测(TSAD)是大规模系统与在线基础设施中的核心问题,如服务可靠性监控、故障诊断与性能优化。尽管大语言模型在时序分析中表现卓越,但多模态大模型(MLLMs),特别是视觉-语言模型,在TSAD中的潜力仍待探索。人类常通过可视化和文本描述识别异常,这启发我们思考:多模态大模型能否胜任时间序列异常检测?现有研究常将点异常简化为区间异常或通过聚合近似处理,限制了对多粒度异常和不规则时序等真实场景的理解。为此,我们构建了VisualTimeAnomaly基准,系统评估MLLMs在零样本条件下从点、区间到变量子粒度的异常检测能力,并扩展至不规则采样场景。研究揭示了多项关键发现。基于此,我们提出多智能体框架TSAD-Agents,包含扫描、规划、检测与检查四类智能体,协同推理、规划与自省,实现自动化异常检测。这些智能体可动态调用传统方法与多模态模型,灵活切换文本与图像模态以优化性能。

原文摘要 · Abstract (English)

Time series anomaly detection (TSAD) has been a long-standing pillar problem in Web-scale systems and online infrastructures, such as service reliability monitoring, system fault diagnosis, and performance optimization. Large language models (LLMs) have demonstrated unprecedented capabilities in time series analysis, the potential of multimodal LLMs (MLLMs), particularly vision-language models, in TSAD remains largely under-explored. One natural way for humans to detect time series anomalies is through visualization and textual description. It motivates our research question: Can multimodal LLMs perform time series anomaly detection? Existing studies often oversimplify the problem by treating point-wise anomalies as special cases of range-wise ones or by aggregating point anomalies to approximate range-wise scenarios. They limit our understanding for realistic scenarios such as multi-granular anomalies and irregular time series. To address the gap, we build a VisualTimeAnomaly benchmark to comprehensively investigate zero-shot capabilities of MLLMs for TSAD, progressively from point-, range-, to variate-wise anomalies, and extends to irregular sampling conditions. Our study reveals several key insights in multimodal MLLMs for TSAD. Built on these findings, we propose a MLLMs-based multi-agent framework TSAD-Agents to achieve automatic TSAD. Our framework comprises scanning, planning, detection, and checking agents that synergistically collaborate to reason, plan, and self-reflect to enable automatic TSAD. These agents adaptively invoke tools such as traditional methods and MLLMs and dynamically switch between text and image modalities to optimize detection performance.

时间序列异常检测多模态智能体

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。