用三分支结构提升时间序列异常检测精度,兼顾效果与内存效率
TriP-LLM: A Tri-Branch Patch-wise Large Language Model Framework for Time-Series Anomaly Detection
- 三分支设计融合局部与全局时序特征,生成分块表示
- 在多个公开数据集上超越现有最优方法,且无需设定阈值
- 内存占用显著低于同类模型,适合资源受限场景
时间序列异常检测在物联网和智能制造等众多领域中至关重要。随着时间序列数据规模与维度的急剧增长,传统统计方法难以应对其高异构性和复杂性。受大语言模型在多模态任务中成功的启发,本文提出一种新型无监督异常检测框架——面向时间序列异常检测的三分支分块大语言模型框架(TriP-LLM)。该框架通过分块、选择与全局模块组成的三分支结构,将输入时间序列编码为分块表示,并交由一个冻结的预训练大语言模型处理。随后,轻量级分块解码器重建输入,基于重建误差计算异常得分。我们在多个公开基准数据集上使用近期提出的无阈值评估指标PATE进行评估,并在统一开源框架内进行公平比较。实验结果表明,TriP-LLM在所有数据集上均持续优于当前最先进方法,展现出强大的检测能力。通过大量消融实验,验证了大语言模型对整体架构的显著贡献。相比采用通道独立(CI)分块处理的基于大语言模型的方法,TriP-LLM实现显著更低的内存消耗,更适合显存受限环境。所有代码与模型权重均已公开于https://github.com/YYZStart/TriP-LLM.git
原文摘要 · Abstract (English)
Time-series anomaly detection plays a central role across a wide range of application domains. With the increasing proliferation of the Internet of Things (IoT) and smart manufacturing, time-series data has dramatically increased in both scale and dimensionality. This growth has exposed the limitations of traditional statistical methods in handling the high heterogeneity and complexity of such data. Inspired by the recent success of large language models (LLMs) in multimodal tasks across language and vision domains, we propose a novel unsupervised anomaly detection framework: A Tri-Branch Patch-wise Large Language Model Framework for Time-Series Anomaly Detection (TriP-LLM). TriP-LLM integrates local and global temporal features through a triple-branch design comprising Patching, Selecting, and Global modules, to encode the input time-series into patch-wise representations, which are then processed by a frozen, pretrained LLM. A lightweight patch-wise decoder reconstructs the input, from which anomaly scores are derived. We evaluate TriP-LLM on several public benchmark datasets using PATE, a recently proposed threshold-free evaluation metric, and conduct all comparisons within a unified open-source framework to ensure fairness. Experimental results show that TriP-LLM consistently outperforms recent state-of-the-art (SOTA) methods across all datasets, demonstrating strong detection capabilities. Furthermore, through extensive ablation studies, we verify the substantial contribution of the LLM to the overall architecture. Compared to LLM-based approaches using Channel Independence (CI) patch processing, TriP-LLM achieves significantly lower memory consumption, making it more suitable for GPU memory-constrained environments. All code and model checkpoints of TriP-LLM are publicly available on https://github.com/YYZStart/TriP-LLM.git
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。