arXiv:2603.12916cs.LGcs.AI2026-03中稿 · KDD被引 1

通过预测注意力查询变化,精准捕捉时序数据的结构异常。

Surprised by Attention: Predictable Query Dynamics for Time Series Anomaly Detection

  • 利用查询向量的可预测性检测跨通道依赖关系变化
  • 在TSB-AD数据集上优于强基线模型,提升定位精度
  • 适合自动驾驶等对依赖关系敏感的场景

多变量时间序列异常常表现为通道间依赖关系的改变,而非简单的幅值波动。例如自动驾驶中转向指令与横向加速度解耦。传统残差检测器可能漏检此类异常,因灵活序列模型仍能合理重建信号。我们提出AxonAD,一种无监督检测方法,将多头注意力查询的演化视为短时可预测过程。采用梯度更新的重建路径,结合仅基于历史的预测器,从过往上下文预测未来查询向量。训练通过掩码预测-目标损失,使用指数移动平均(EMA)目标编码器。推理时,将重构误差与尾部聚合的查询不匹配分数结合,该分数衡量近期时间步上预测与目标查询的余弦偏差。此双重机制在保留幅值检测能力的同时,对结构依赖变化更敏感。在自有车载遥测数据(含区间标注)和TSB-AD多变量基准(17个数据集,180个序列)上,使用无阈值和范围感知指标,AxonAD在排名质量与时间定位上均优于强基线。消融实验确认查询预测与联合评分是性能提升的主要驱动因素。代码已开源。

原文摘要 · Abstract (English)

Multivariate time series anomalies often manifest as shifts in cross-channel dependencies rather than simple amplitude excursions. In autonomous driving, for instance, a steering command might be internally consistent but decouple from the resulting lateral acceleration. Residual-based detectors can miss such anomalies when flexible sequence models still reconstruct signals plausibly despite altered coordination. We introduce AxonAD, an unsupervised detector that treats multi-head attention query evolution as a short horizon predictable process. A gradient-updated reconstruction pathway is coupled with a history-only predictor that forecasts future query vectors from past context. This is trained via a masked predictor-target objective against an exponential moving average (EMA) target encoder. At inference, reconstruction error is combined with a tail-aggregated query mismatch score, which measures cosine deviation between predicted and target queries on recent timesteps. This dual approach provides sensitivity to structural dependency shifts while retaining amplitude-level detection. On proprietary in-vehicle telemetry with interval annotations and on the TSB-AD multi-variate suite (17 datasets, 180 series) with threshold-free and range-aware metrics, AxonAD improves ranking quality and temporal localization over strong baselines. Ablations confirm that query prediction and combined scoring are the primary drivers of the observed gains. Code is available at the URL https://github.com/iis-esslingen/AxonAD.

异常检测注意力机制时序分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。