用视觉语言模型提升时间序列异常检测,无需训练即可大幅提高准确率和效率。
Harnessing Vision-Language Models for Time Series Anomaly Detection
- 分两阶段:先用轻量视觉编码器定位异常候选,再用VLM融合上下文精炼结果。
- 不需时序训练,F1-max提升24.6%,平均令牌使用减少36倍。
- 适合关注少样本、高效率异常检测的研究者与工业应用者。
时间序列异常检测在医疗、金融及传感器监控等领域至关重要。以往方法主要基于数值数据训练专用模型,缺乏人类专家所具备的时空理解能力。为此,本文探索利用视觉语言模型(VLMs)解决该问题。尽管近期研究显示VLM在视觉理解任务中表现优异,但其直接应用于时间序列时在准确性和效率上均不足。为此,我们提出两阶段方案:(1) ViT4TS,基于轻量预训练视觉编码器的视觉筛选阶段,利用二维时间序列表示精准定位异常候选;(2) VLM4TS,基于VLM的阶段,整合全局时序上下文与视觉理解能力,对ViT4TS提供的候选进行精炼。实验表明,无需任何时间序列训练,VLM4TS在多数情况下超越预训练与时序从头训练基线,F1-max得分提升24.6%;同时显著优于现有基于语言模型的检测方法,平均令牌使用量减少36倍。
原文摘要 · Abstract (English)
Time-series anomaly detection (TSAD) has played a vital role in a variety of fields, including healthcare, finance, and sensor-based condition monitoring. Prior methods, which mainly focus on training domain-specific models on numerical data, lack the visual-temporal understanding capacity that human experts have to identify contextual anomalies. To fill this gap, we explore a solution based on vision language models (VLMs). Recent studies have shown the ability of VLMs for visual understanding tasks, yet their direct application to time series has fallen short on both accuracy and efficiency. To harness the power of VLMs for TSAD, we propose a two-stage solution, with (1) ViT4TS, a vision-screening stage built on a relatively lightweight pre-trained vision encoder, which leverages 2D time series representations to accurately localize candidate anomalies; (2) VLM4TS, a VLM-based stage that integrates global temporal context and VLM's visual understanding capacity to refine the detection upon the candidates provided by ViT4TS. We show that without any time-series training, VLM4TS outperforms time-series pre-trained and from-scratch baselines in most cases, yielding a 24.6% improvement in F1-max score over the best baseline. Moreover, VLM4TS also consistently outperforms existing language model-based TSAD methods and is on average 36x more efficient in token usage.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。