arXiv:2504.08803cs.LG2025-04被引 3

提出TSTransformer模型,提升质子交换膜燃料电池剩余寿命预测精度。

A temporal scale transformer framework for precise remaining useful life prediction in fuel cells

  • 将时间序列分阶段映射为多尺度令牌,增强长短期依赖建模能力。
  • 通过一维卷积改进注意力机制,降低计算开销并提升局部特征提取。
  • 在多个数据集上优于LSTM、iTransformer等模型,适合能源系统健康监测。

在质子交换膜燃料电池(PEMFC)的预测性健康管理(PHM)研究中,尽管基于数据驱动的Transformer模型在众多领域表现优异,但其自注意力机制导致输入序列复杂度平方增长,计算效率低下,且难以同时捕捉全局长期依赖与局部细节。为此,本文提出时序尺度变换器(TSTransformer),作为反向Transformer(iTransformer)的改进版本。不同于传统Transformer将每个时间步视为输入标记,TSTransformer将不同长度序列映射到多阶段标记,利用注意力机制捕获多变量相关性,并通过前馈网络编码序列表示。通过在多变量注意力中引入一维卷积层对键(K)和值(V)矩阵进行多级缩放,显著提升局部特征提取能力,捕获时序尺度特性,减少标记数量与计算成本。实验表明,TSTransformer在多个对比模型(如LSTM、iTransformer、Transformer)中表现更优,展现出在可再生能源系统预测性健康管理中的强大潜力。

原文摘要 · Abstract (English)

In exploring Predictive Health Management (PHM) strategies for Proton Exchange Membrane Fuel Cells (PEMFC), the Transformer model, widely used in data-driven approaches, excels in many fields but struggles with time series analysis due to its self-attention mechanism, which yields a complexity of the input sequence squared and low computational efficiency. It also faces challenges in capturing both global long-term dependencies and local details effectively. To tackle this, we propose the Temporal Scale Transformer (TSTransformer), an enhanced version of the inverted Transformer (iTransformer). Unlike traditional Transformers that treat each timestep as an input token, TSTransformer maps sequences of varying lengths into tokens at different stages for inter-sequence modeling, using attention to capture multivariate correlations and feed-forward networks (FFN) to encode sequence representations. By integrating a one-dimensional convolutional layer into the multivariate attention for multi-level scaling of K and V matrices, it improves local feature extraction, captures temporal scale characteristics, and reduces token count and computational costs. Experiments comparing TSTransformer with models like Long Short-Term Memory, iTransformer, and Transformer demonstrate its potential as a powerful tool for advancing PHM in renewable energy, effectively addressing the limitations of pure Transformer models in data-driven time series tasks.

燃料电池时间序列Transformer寿命预测

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。