用时序分类选最优异常检测模型,提升效果且不慢。
MSAD: A Deep Dive into Model Selection for Time series Anomaly Detection
- 用16种分类器分析时序特征,自动选最适合的异常检测方法。
- 在1980+时序上测试,选型方案整体优于单个检测模型。
- 为AutoML中的模型选择提供首个可复现的高效基准。
异常检测是时间序列分析的基础任务,对众多下游应用性能影响重大。尽管学术界研究热度高,已有大量方法提出,但近期基准测试表明,在异构时间序列数据集上并不存在普适最优的检测方法。因此,面对来自不同领域的多样化时间序列,唯一可行且可扩展的解决方案是设计模型选择方法,依据时间序列特征自动挑选最优的异常检测算法。现有AutoML方案难以直接应用于时间序列异常检测,且尚无针对此类方法的评估研究。本文首次系统评估了将时间序列分类方法用于异常检测模型选择的有效性。共测试234种模型配置(源自16种基础分类器),覆盖1980多个时间序列。结果表明,模型选择方法整体性能超越任一单一检测方法,且执行时间仅处于同一量级。该评估是证明时间序列分类算法在异常检测中兼具准确与高效的首项工作,为通用AutoML流程中的模型选择步骤提供了强有力的基准。
原文摘要 · Abstract (English)
Anomaly detection is a fundamental task for time series analytics with important implications for the downstream performance of many applications. Despite increasing academic interest and the large number of methods proposed in the literature, recent benchmarks and evaluation studies demonstrated that no overall best anomaly detection methods exist when applied to very heterogeneous time series datasets. Therefore, the only scalable and viable solution to solve anomaly detection over very different time series collected from diverse domains is to propose a model selection method that will select, based on time series characteristics, the best anomaly detection methods to run. Existing AutoML solutions are, unfortunately, not directly applicable to time series anomaly detection, and no evaluation of time series-based approaches for model selection exists. Towards that direction, this paper studies the performance of time series classification methods used as model selection for anomaly detection. In total, we evaluate 234 model configurations derived from 16 base classifiers across more than 1980 time series, and we propose the first extensive experimental evaluation of time series classification as model selection for anomaly detection. Our results demonstrate that model selection methods outperform every single anomaly detection method while being in the same order of magnitude regarding execution time. This evaluation is the first step to demonstrate the accuracy and efficiency of time series classification algorithms for anomaly detection, and represents a strong baseline that can then be used to guide the model selection step in general AutoML pipelines. Preprint version of an article accepted at the VLDB Journal.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。