arXiv:2603.04146cs.CV2026-03

将稀疏编码与Transformer结合,提升故障诊断准确率

LISTA-Transformer Model Based on Sparse Coding and Attention Mechanism and Its Application in Fault Diagnosis

  • 用LISTA算法实现可学习的稀疏编码,融合局部与全局特征
  • 在CWRU数据集上故障识别率达98.5%,优于传统方法3.3%
  • 适合需要高精度、可解释性工业故障诊断场景

受多层感知机、卷积神经网络(CNN)和Transformer等模型发展推动,深度学习在计算机视觉与自然语言处理等领域取得突破,并成功应用于图像分类及工业故障诊断。然而,现有模型在局部特征建模与全局依赖捕捉方面仍存在局限:CNN受局部感受野限制,Transformer难以有效建模局部结构,且二者普遍存在模型复杂度高、可解释性差的问题。针对上述问题,本文提出一种基于可学习迭代收缩阈值算法(LISTA)的稀疏Transformer(LISTA-Transformer),深度融合LISTA稀疏编码与视觉Transformer,构建具备自适应局部-全局特征协同机制的模型架构。该方法利用连续小波变换将振动信号转换为时频图,并输入至LISTA-Transformer进行更有效的特征提取。在CWRU数据集上,本方法的故障识别率达到了98.5%,较传统方法提升3.3%,并优于现有基于Transformer的方法。

原文摘要 · Abstract (English)

Driven by the continuous development of models such as Multi-Layer Perceptron, Convolutional Neural Network (CNN), and Transformer, deep learning has made breakthrough progress in fields such as computer vision and natural language processing, and has been successfully applied in practical scenarios such as image classification and industrial fault diagnosis. However, existing models still have certain limitations in local feature modeling and global dependency capture. Specifically, CNN is limited by local receptive fields, while Transformer has shortcomings in effectively modeling local structures, and both face challenges of high model complexity and insufficient interpretability. In response to the above issues, we proposes the following innovative work: A sparse Transformer based on Learnable Iterative Shrinkage Threshold Algorithm (LISTA-Transformer) was designed, which deeply integrates LISTA sparse encoding with visual Transformer to construct a model architecture with adaptive local and global feature collaboration mechanism. This method utilizes continuous wavelet transform to convert vibration signals into time-frequency maps and inputs them into LISTA-Transformer for more effective feature extraction. On the CWRU dataset, the fault recognition rate of our method reached 98.5%, which is 3.3% higher than traditional methods and exhibits certain superiority over existing Transformer-based approaches.

故障诊断稀疏编码Transformer信号处理

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。