用大模型提升云服务异常检测效率,帮运维工程师提前发现问题。
LLM Assisted Anomaly Detection Service for Site Reliability Engineers: Enhancing Cloud Infrastructure Resilience
- 用大语言模型理解系统组件与故障模式,构建通用异常检测逻辑。
- 一年服务超20万次调用,支持单变量和多变量时间序列异常检测。
- 适合云运维、物联网场景,可零样本扩展至新系统。
本文提出一种可扩展的异常检测服务,针对工业时间序列数据设计通用API,帮助站点可靠性工程师(SREs)管理云基础设施。该服务支持复杂数据流中的高效异常检测,实现问题的主动识别与解决。创新性地利用大语言模型(LLMs)理解关键组件、故障模式及行为特征,构建异常检测模型。提供基于回归、混合模型和半监督学习的多种算法,适用于单变量与多变量时间序列。服务上线一年内累计超过500名用户、20万次API调用,已在物联网驱动的AI应用等工业场景成功部署。在公开异常检测基准上验证了有效性。通过该系统,SREs可提前发现潜在问题,减少停机时间,提升事件响应速度,改善整体用户体验。未来计划引入时间序列基础模型,实现零样本异常检测能力。
原文摘要 · Abstract (English)
This paper introduces a scalable Anomaly Detection Service with a generalizable API tailored for industrial time-series data, designed to assist Site Reliability Engineers (SREs) in managing cloud infrastructure. The service enables efficient anomaly detection in complex data streams, supporting proactive identification and resolution of issues. Furthermore, it presents an innovative approach to anomaly modeling in cloud infrastructure by utilizing Large Language Models (LLMs) to understand key components, their failure modes, and behaviors. A suite of algorithms for detecting anomalies is offered in univariate and multivariate time series data, including regression-based, mixture-model-based, and semi-supervised approaches. We provide insights into the usage patterns of the service, with over 500 users and 200,000 API calls in a year. The service has been successfully applied in various industrial settings, including IoT-based AI applications. We have also evaluated our system on public anomaly benchmarks to show its effectiveness. By leveraging it, SREs can proactively identify potential issues before they escalate, reducing downtime and improving response times to incidents, ultimately enhancing the overall customer experience. We plan to extend the system to include time series foundation models, enabling zero-shot anomaly detection capabilities.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。