arXiv:2409.15366cs.LGcs.AI2024-09被引 13

用语言模型思路检测轨迹异常,精准识别用户行为中的异常点。

Trajectory Anomaly Detection with Language Models

  • 将轨迹视为令牌序列,用自回归模型学习其概率分布。
  • 在真实数据集上优于现有方法,对用户上下文异常检测准确率高。
  • 支持多种轨迹表示,适合在线实时检测,计算延迟显著降低。

本文提出一种基于自回归因果注意力模型的轨迹异常检测新方法LM-TAD。该方法利用语言陈述与轨迹在有序元素及上下文依赖方面的相似性,将轨迹视为令牌序列,学习其概率分布以识别异常位置。通过引入用户特定令牌,模型能捕捉个体行为模式,提升上下文感知能力。实验表明,LM-TAD在合成数据和真实数据集上均表现优异:在Pattern of Life(PoL)数据集上成功检测用户上下文异常,在波尔图出租车数据集上也达到有竞争力的结果。研究还引入困惑度与意外率指标用于定位具体异常点。该框架支持包括GPS坐标、停留点和活动类型在内的多种轨迹表示,具备高度灵活性。此外,通过缓存注意力机制的关键值状态,模型可显著降低在线检测时的计算延迟,避免重复计算。

原文摘要 · Abstract (English)

This paper presents a novel approach for trajectory anomaly detection using an autoregressive causal-attention model, termed LM-TAD. This method leverages the similarities between language statements and trajectories, both of which consist of ordered elements requiring coherence through external rules and contextual variations. By treating trajectories as sequences of tokens, our model learns the probability distributions over trajectories, enabling the identification of anomalous locations with high precision. We incorporate user-specific tokens to account for individual behavior patterns, enhancing anomaly detection tailored to user context. Our experiments demonstrate the effectiveness of LM-TAD on both synthetic and real-world datasets. In particular, the model outperforms existing methods on the Pattern of Life (PoL) dataset by detecting user-contextual anomalies and achieves competitive results on the Porto taxi dataset, highlighting its adaptability and robustness. Additionally, we introduce the use of perplexity and surprisal rate metrics for detecting outliers and pinpointing specific anomalous locations within trajectories. The LM-TAD framework supports various trajectory representations, including GPS coordinates, staypoints, and activity types, proving its versatility in handling diverse trajectory data. Moreover, our approach is well-suited for online trajectory anomaly detection, significantly reducing computational latency by caching key-value states of the attention mechanism, thereby avoiding repeated computations.

轨迹异常语言模型在线检测用户建模

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。