arXiv:2603.21612cs.LG2026-03被引 5

用语义对齐与信息浓缩提升多模态时间序列异常检测效果

Towards Multimodal Time Series Anomaly Detection with Semantic Alignment and Condensed Interaction

  • 通过细粒度时序-文本对齐融合异构模态信息
  • 在6个真实数据集上超越现有方法,准确率显著提升
  • 适合需要融合文本与数值数据的工业异常检测场景

时间序列异常检测在众多动态系统中至关重要。然而,以往方法主要依赖单一数值数据,忽视了其他模态的互补信息。本文提出一种新型多模态时间序列异常检测模型MindTS,聚焦解决两大挑战:(1) 如何实现异构多模态数据间的语义一致性对齐;(2) 如何过滤冗余模态信息以增强跨模态交互。针对第一挑战,提出细粒度时序-文本语义对齐,通过跨视图文本融合与多模态对齐机制,实现时序与文本模态间的语义一致对齐。针对第二挑战,引入内容浓缩重构,对对齐后的文本模态进行冗余信息过滤,并执行跨模态重构以促进交互。在六个真实世界多模态数据集上的大量实验表明,所提MindTS在性能上达到或优于现有方法。代码已开源:https://github.com/decisionintelligence/MindTS。

原文摘要 · Abstract (English)

Time series anomaly detection plays a critical role in many dynamic systems. Despite its importance, previous approaches have primarily relied on unimodal numerical data, overlooking the importance of complementary information from other modalities. In this paper, we propose a novel multimodal time series anomaly detection model (MindTS) that focuses on addressing two key challenges: (1) how to achieve semantically consistent alignment across heterogeneous multimodal data, and (2) how to filter out redundant modality information to enhance cross-modal interaction effectively. To address the first challenge, we propose Fine-grained Time-text Semantic Alignment. It integrates exogenous and endogenous text information through cross-view text fusion and a multimodal alignment mechanism, achieving semantically consistent alignment between time and text modalities. For the second challenge, we introduce Content Condenser Reconstruction, which filters redundant information within the aligned text modality and performs cross-modal reconstruction to enable interaction. Extensive experiments on six real-world multimodal datasets demonstrate that the proposed MindTS achieves competitive or superior results compared to existing methods. The code is available at: https://github.com/decisionintelligence/MindTS.

多模态异常检测时序分析

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。