arXiv:2411.11620cs.LGcs.AI2024-11被引 10

融合Swin Transformer与神经树,提升时序分类准确率与可解释性。

ST-Tree with Interpretability for Multivariate Time Series Classification

  • 用Swin Transformer捕捉多尺度时序特征,增强表示能力。
  • 在10个UEA数据集上平均准确率提升3.2%,同时支持决策路径可视化。
  • 适合需要模型透明度的医疗、金融等高风险场景应用。

多变量时间序列分类在实际应用中至关重要,但深度神经网络如Transformer虽精度高却缺乏可解释性,传统决策树虽透明但准确率较低。Swin Transformer(ST)通过自注意力机制捕获细粒度局部与全局模式,支持多尺度特征学习,提供更全面的时序表征。为此,本文提出具有可解释性的ST-Tree模型,将ST作为主干网络,并结合神经树结构,在保留其上下文学习优势的同时,通过神经树提供清晰的决策过程。实验在10个UEA数据集上验证了该模型在多变量时间序列分类任务中的更高准确率,并通过可视化展示了不同数据集上的决策路径,使研究人员能深入理解模型判断逻辑。

原文摘要 · Abstract (English)

Multivariate time series classification is of great importance in practical applications and is a challenging task. However, deep neural network models such as Transformers exhibit high accuracy in multivariate time series classification but lack interpretability and fail to provide insights into the decision-making process. On the other hand, traditional approaches based on decision tree classifiers offer clear decision processes but relatively lower accuracy. Swin Transformer (ST) addresses these issues by leveraging self-attention mechanisms to capture both fine-grained local patterns and global patterns. It can also model multi-scale feature representation learning, thereby providing a more comprehensive representation of time series features. To tackle the aforementioned challenges, we propose ST-Tree with interpretability for multivariate time series classification. Specifically, the ST-Tree model combines ST as the backbone network with an additional neural tree model. This integration allows us to fully leverage the advantages of ST in learning time series context while providing interpretable decision processes through the neural tree. This enables researchers to gain clear insights into the model's decision-making process and extract meaningful interpretations. Through experimental evaluations on 10 UEA datasets, we demonstrate that the ST-Tree model improves accuracy in multivariate time series classification tasks and provides interpretability through visualizing the decision-making process across different datasets.

时间序列可解释性Swin Transformer神经树

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。