让时间序列模型更好理解设备状态,提升异常检测准确率。
STAR: Boosting Time Series Foundation Models for Anomaly Detection through State-aware Adapter
- 用状态记忆捕捉离散状态的语义信息
- 根据当前状态动态调整模型参数,增强适应性
- 专门检测状态本身异常,适合工业时序场景
尽管时间序列基础模型(TSFMs)在多变量时间序列异常检测(MTSAD)中表现优异,但在真实工业场景中,时间序列不仅包含温度、流量等数值变量,还包含大量描述系统状态的离散变量(如阀门开关、星期几)。现有TSFMs通常将这些状态变量与数值变量同等处理,忽略了其分类性质和作为条件的关键作用,导致引入状态变量后检测性能显著下降。为此,本文提出一种即插即用的星状适配器(STAR),用于在微调阶段增强TSFMs对状态变量的建模能力。STAR包含三个核心组件:(1) 基于可学习状态记忆的身份引导状态编码器,有效捕获状态变量的复杂语义;(2) 条件瓶颈适配器,根据当前状态动态生成低秩适配参数,灵活注入状态影响;(3) 数值-状态匹配模块,更有效地检测状态自身异常。在真实数据集上的大量实验表明,STAR能显著提升现有TSFMs在MTSAD任务中的性能。
原文摘要 · Abstract (English)
While Time Series Foundation Models (TSFMs) have demonstrated remarkable success in Multivariate Time Series Anomaly Detection (MTSAD), however, in real-world industrial scenarios, many time series comprise not only numerical variables such as temperature and flow, but also numerous discrete state variables that describe the system status, such as valve on/off or day of the week. Existing TSFMs often overlook the distinct categorical nature of state variables and their critical role as conditions, typically treating them uniformly with numerical variables. This inappropriate modeling approach prevents the model from fully leveraging state information and even leads to a significant degradation in detection performance after state variables are integrated. To address this critical limitation, this paper proposes a novel STate-aware AdapteR (STAR). STAR is a plug-and-play module designed to enhance the capability of TSFMs in modeling and leveraging state variables during the fine-tuning stage. Specifically, STAR comprisesthree core components: (1) We design an Identity-guided State Encoder, whicheffectively captures the complex categorical semantics of state variables through a learnable State Memory. (2) We propose a Conditional Bottleneck Adapter, which dynamically generates low-rank adaptation parameters conditioned on the current state, thereby flexibly injecting the influence of state variables into the backbone model. (3) We also introduce a Numeral-State Matching module to more effectively detect anomalies inherent to the state variables themselves. Extensive experiments conducted on real-world datasets demonstrate that STAR can improve the performance of existing TSFMs on MTSAD.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。