轻量级时序异常检测模型,提升多变量依赖建模与计算效率。
PaAno+: Multiscale Encoding and Cross-Variable Attention for Time Series Anomaly Detection

- 多尺度卷积+跨尺度注意力,捕捉时序层级特征。
- 跨变量融合注意力显著提升多变量异常识别准确率。
- 适合资源受限设备实时部署,性能优于现有轻量模型。
时序异常检测在工业、医疗监控等关键领域具有重要应用价值。现有基于Transformer和大模型的方法计算开销过大,而轻量级方法又受限于特征提取不足和多变量依赖建模能力弱。为此,本文提出一种轻量高效的异常检测模型PaAno,基于补丁导向表征学习框架。编码器采用不同感受野的卷积核构建多尺度特征提取骨干,结合跨尺度自适应注意力聚合与残差连接优化,稳定特征表示学习;嵌入跨变量融合注意力模块,显式建模变量间相关性,提升复杂工况下的异常模式识别能力。此外,设计基于时间补丁窗口排序的新型预训练任务,揭示时序内在结构特性,并引入三元组损失优化补丁嵌入空间,增强特征区分度。在TSB-AD基准上的大量实验表明,所提PaAno在单变量与多变量任务上均达到当前最优检测精度,各项指标(包括VUS-PR)相较原始PaAno有显著提升。通过紧凑网络设计,模型具备良好计算效率,支持在资源受限终端实现实时异常推理。
原文摘要 · Abstract (English)
Time-series anomaly detection has significant practical value for industrial and medical monitoring, as well as other critical domains. Current Transformer- and large-model-based detection approaches incur excessive computational overhead, while existing lightweight alternatives are constrained by insufficient feature extraction and inadequate modeling of dependencies across multivariate variables. To mitigate the above drawbacks, this study develops a lightweight, efficient anomaly detection model, dubbed PaAno, within the patch-oriented representation learning paradigm. In the encoder module, a multiscale feature-extraction backbone is constructed using convolutional kernels with differentiated receptive fields to capture hierarchical temporal characteristics; subsequent cross-scale adaptive attention aggregation, combined with residual connection optimization, further stabilizes feature representation learning. A cross-variable fusion attention module is embedded to explicitly characterize inter-variable correlations, empowering the model to identify anomalous patterns amid intricate operational conditions. Moreover, a novel pretext task based on temporal patch-window sorting is customized to uncover intrinsic structural properties of time series, and triplet loss is leveraged to optimize the patch embedding space for enhanced feature discrimination. Extensive experiments on the TSB-AD benchmark demonstrate that the proposed PaAno achieves state-of-the-art detection accuracy on both univariate and multivariate tasks, yielding significant performance gains across evaluation metrics, including VUS-PR, relative to the original PaAno. Leveraging a compact network design, the presented model achieves favorable computational efficiency, enabling deployment on resource-limited terminals for real-time anomaly inference.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。