用排列机制让时序数据适配ViT,提升设备剩余寿命预测精度。
PerFormer: A Permutation Based Vision Transformer for Remaining Useful Life Prediction
- 通过可学习的排列矩阵将多变量时序数据转为类图像结构
- 在NASA C-MAPSS数据集上达到当前最优的RUL预测误差
- 适合需要高精度寿命预测的工业设备健康管理场景
准确估计退化系统的剩余使用寿命(RUL)对现代预测性维护与健康管理系统(PHM)至关重要。卷积神经网络(CNN)最初用于图像和视频识别,已在RUL预测中表现出卓越性能。然而,随着视觉变压器(ViT)在图像分类等计算机视觉任务中的优越表现,探索其在提升RUL预测精度方面的潜力成为自然趋势。直接将ViT应用于多变量传感器数据面临挑战,主要源于时间序列数据空间信息不明确。为此,我们提出PerFormer,一种基于排列的视觉变压器方法,通过排列多变量时间序列数据,模拟图像数据的空间特征,使其适配ViT。为生成所需排列矩阵,我们设计了一种新型排列损失函数,引导任意矩阵收敛至排列矩阵。在NASA C-MAPSS数据集上的实验表明,PerFormer在RUL预测方面优于采用CNN、循环神经网络(RNN)及多种Transformer模型的先进方法,凸显其在PHM应用中的有效性和潜力。
原文摘要 · Abstract (English)
Accurately estimating the remaining useful life (RUL) for degradation systems is crucial in modern prognostic and health management (PHM). Convolutional Neural Networks (CNNs), initially developed for tasks like image and video recognition, have proven highly effectively in RUL prediction, demonstrating remarkable performance. However, with the emergence of the Vision Transformer (ViT), a Transformer model tailored for computer vision tasks such as image classification, and its demonstrated superiority over CNNs, there is a natural inclination to explore its potential in enhancing RUL prediction accuracy. Nonetheless, applying ViT directly to multivariate sensor data for RUL prediction poses challenges, primarily due to the ambiguous nature of spatial information in time series data. To address this issue, we introduce the PerFormer, a permutation-based vision transformer approach designed to permute multivariate time series data, mimicking spatial characteristics akin to image data, thereby making it suitable for ViT. To generate the desired permutation matrix, we introduce a novel permutation loss function aimed at guiding the convergence of any matrix towards a permutation matrix. Our experiments on NASA's C-MAPSS dataset demonstrate the PerFormer's superior performance in RUL prediction compared to state-of-the-art methods employing CNNs, Recurrent Neural Networks (RNNs), and various Transformer models. This underscores its effectiveness and potential in PHM applications.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。