用递归语言模型精准定位长时序数据中的异常点
TimeRLM: Recursive Language Models Enable Precise Anomaly Localization in Long-Context Time-Series

- 通过代码递归操作时序信号,外部维护上下文提升定位能力
- 在合成数据上实现0.682的定位重合率,远超基线模型
- 仅用合成数据训练,却在真实心电图等数据上表现优异
长时序数据中的精确异常定位在临床、工业、金融和物流监控中至关重要,但短时异常可能隐藏于高频长序列中。现有时间序列语言模型(TSLM)虽能以自然语言输出异常结论,但在长上下文下性能显著下降,类似文本、视觉和音频领域的缺陷。我们提出TimeRLM,一种基于递归语言模型(RLM)的时间序列框架,通过代码逐步操控信号并调用视觉能力。我们构建AnomalyXL,一个包含五类任务的合成基准,支持多选题与精确定位两种形式。TimeRLM在四个定位任务上优于所有对比模型,定位交并比达0.682,分类带证据准确率达0.745,而基线最高仅0.329和0.072。通过强化学习微调,模型性能进一步提升,推理交互轮次减少约三分之二。在未见的真实世界ECG、睡眠及软件可观测性数据上,其表现保持或超越TSLMs,尽管仅在合成数据上训练。
原文摘要 · Abstract (English)
Precise anomaly localization over long-context time series is a crucial task in monitoring applications across clinical care, industrial operations, financial services, and logistics, where brief evidence may hide inside long spans of high-frequency data. Time-Series Language Models (TSLMs) are able to ingest time series data and verbalize findings on anomalies in natural language; however, recent benchmarks report a decrease in retrieval performance at long contexts, mirroring failure modes in text, vision, and audio. In the text domain, Recursive Language Models (RLMs) can recover much of this lost performance by keeping context external to the large language model (LLM), allowing the model to query it through code. We present TimeRLM, an RLM formulation for time-series that sequentially manipulates the signal using code and vision capabilities. We further introduce AnomalyXL, a synthetic long-context anomaly localization benchmark with programmatically injected anomalies that require precise retrieval. We implement five different task categories and two variants: AnomalyXL-MCQ and AnomalyXL-Localize. TimeRLM outperforms every evaluated TSLM and single-pass baseline on four of the five AnomalyXL-Localize tasks, reaching 0.682 IoU on localization and 0.745 on classify-with-evidence, versus at most 0.329 and 0.072 across all baselines. We post-train TimeRLM using reinforcement learning. The resulting model further improves performance and requires approximately one-third as many agent interaction turns as its untrained base model to produce a final answer. On unseen real-world ECG, sleep and software observability recordings, the post-trained TimeRLM retains or improves performance, surpassing TSLMs despite being trained exclusively on synthetic data. Our findings suggest recursive interaction with time-series is an effective approach for long-horizon retrieval.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。