用视觉模型做时间序列异常检测,提升跨数据集泛化能力。
VAN-AD: Visual Masked Autoencoder with Normalizing Flow For Time Series Anomaly Detection
- 将ImageNet预训练的视觉MAE迁移到时间序列异常检测
- 在9个真实数据集上优于现有方法,最佳指标提升12.3%
- 适合缺乏标注数据的工业场景异常检测
时间序列异常检测(TSAD)对保障物联网服务系统的可靠性与安全性至关重要。现有方法需为每个数据集单独训练模型,泛化能力差,在数据稀缺场景下表现受限。为此,基础模型成为新方向,但现有方案或复用大语言模型,或构建大规模时序数据集,仍面临跨模态差距和域内异质性挑战。本文探索将大规模视觉模型用于TSAD。具体地,将ImageNet预训练的视觉掩码自编码器(MAE)适配至TSAD任务。直接迁移存在过拟合和局部感知弱两大问题。为此提出VAN-AD框架:设计自适应分布映射模块(ADMM),将MAE重构结果映射到统一统计空间以放大异常模式差异;引入归一化流模块(NFM),结合MAE与归一化流,估计当前窗口在全局分布下的概率密度。在九个真实世界数据集上的实验表明,VAN-AD在多个评估指标上持续优于现有最先进方法。代码与数据集已公开于https://github.com/PenyChen/VAN-AD。
原文摘要 · Abstract (English)
Time series anomaly detection (TSAD) is essential for maintaining the reliability and security of IoT-enabled service systems. Existing methods require training one specific model for each dataset, which exhibits limited generalization capability across different target datasets, hindering anomaly detection performance in various scenarios with scarce training data. To address this limitation, foundation models have emerged as a promising direction. However, existing approaches either repurpose large language models (LLMs) or construct largescale time series datasets to develop general anomaly detection foundation models, and still face challenges caused by severe cross-modal gaps or in-domain heterogeneity. In this paper, we investigate the applicability of large-scale vision models to TSAD. Specifically, we adapt a visual Masked Autoencoder (MAE) pretrained on ImageNet to the TSAD task. However, directly transferring MAE to TSAD introduces two key challenges: overgeneralization and limited local perception. To address these challenges, we propose VAN-AD, a novel MAE-based framework for TSAD. To alleviate the over-generalization issue, we design an Adaptive Distribution Mapping Module (ADMM), which maps the reconstruction results before and after MAE into a unified statistical space to amplify discrepancies caused by abnormal patterns. To overcome the limitation of local perception, we further develop a Normalizing Flow Module (NFM), which combines MAE with normalizing flow to estimate the probability density of the current window under the global distribution. Extensive experiments on nine real-world datasets demonstrate that VAN-AD consistently outperforms existing state-of-the-art methods across multiple evaluation metrics.We make our code and datasets available at https://github.com/PenyChen/VAN-AD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。