用大模型实时判断异常,让系统自动适应数据变化。
CALM: A Framework for Continuous, Adaptive, and LLM-Mediated Anomaly Detection in Time-Series Streams
- 通过闭环微调让模型持续学习流数据新模式。
- 在TSB-UAD上,自适应模型的ROC AUC优于静态基线。
- 适合需要长期稳定检测的工业实时监控场景。
非平稳时间序列流中的异常检测在众多工业与科学领域中至关重要但极具挑战。传统离线训练模型在面对概念漂移(数据统计特性随时间变化)时性能显著下降。本文提出CALM(Continuous, Adaptive, and LLM-Mediated),一种基于Apache Beam分布式框架、利用TimesFm基础模型进行预测式异常检测的端到端实时检测框架。其核心贡献有二:一是实现近实时的闭环连续微调机制,使模型能动态适应数据演变;二是引入LLM-as-a-Judge组件,由大语言模型对检测出的异常进行语义化、上下文感知的判断,区分瞬时噪声与真实模式改变,从而构建高质量训练数据集。我们在全面的TSB-UAD基准上评估了CALM,结果表明,持续微调模型在多数数据集上的ROC AUC均优于静态预训练基线模型,验证了该自适应、大模型引导方法在动态流环境中的有效性。
原文摘要 · Abstract (English)
The detection of anomalies in non-stationary time-series streams is a critical but challenging task across numerous industrial and scientific domains. Traditional models, trained offline, suffer significant performance degradation when faced with concept drift, where the underlying statistical properties of the data change over time. This paper introduces CALM (Continuous, Adaptive, and LLM-Mediated), a novel, end-to-end framework for real-time anomaly detection designed to address this challenge. CALM is built on the Apache Beam distributed processing framework and leverages the TimesFm foundation model for forecasting-based anomaly detection. The framework's novelty lies in two core contributions. First, it implements a closed-loop, continuous fine-tuning mechanism that allows the anomaly detection model to adapt to evolving data patterns in near real-time. Second, it introduces an LLM-as-a-Judge component, a Large Language Model that provides semantic, context-aware judgments on detected anomalies to curate a high-quality training dataset, deciding whether an anomaly represents transient noise or a meaningful pattern shift. We evaluate CALM on the comprehensive TSB-UAD benchmark. Our results demonstrate that the continuously fine-tuned model improves the ROC AUC score in most datasets compared to the static, pre-trained base model, validating the efficacy of our adaptive, LLM-guided approach to maintaining high-performance anomaly detection in dynamic streaming environments.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。