用Transformer改进时序特征提取,提升工业设备异常检测精度。
Time-EAPCR-T: A Universal Deep Learning Approach for Anomaly Detection in Industrial Equipment
- 用Transformer替代LSTM,增强多源异构数据的时序建模能力。
- 在四个工业数据集上优于现有方法,准确率显著提升。
- 适合需要高精度实时监测的智能制造场景。
随着工业4.0的发展,智能制造广泛采用传感器进行多维度实时数据采集,在设备监控、流程优化和效率提升中发挥关键作用。工业数据具有多源异构、非线性、强耦合及时间交互等特性,且易受噪声干扰,传统异常检测方法难以有效提取关键特征,影响检测准确性和稳定性。传统机器学习方法受限于处理能力和泛化性能,难以满足实际需求。尽管深度学习在图像与文本处理中表现优异,但在缺乏显式关联的多源异构工业数据上仍效果有限。现有处理技术依赖降维与特征选择,易造成信息损失,难捕捉高阶交互。为此,本文基于前期研究提出的EAPCR与Time-EAPCR模型,提出新模型Time-EAPCR-T,将Time-EAPCR中时序模块的LSTM替换为Transformer,有效缓解多源数据异构性问题,实现高效多源特征融合,并增强对多源工业数据的时序特征提取能力。实验结果表明,该方法在四个工业数据集上均优于现有方法,展现出广泛应用潜力。
原文摘要 · Abstract (English)
With the advancement of Industry 4.0, intelligent manufacturing extensively employs sensors for real-time multidimensional data collection, playing a crucial role in equipment monitoring, process optimisation, and efficiency enhancement. Industrial data exhibit characteristics such as multi-source heterogeneity, nonlinearity, strong coupling, and temporal interactions, while also being affected by noise interference. These complexities make it challenging for traditional anomaly detection methods to extract key features, impacting detection accuracy and stability. Traditional machine learning approaches often struggle with such complex data due to limitations in processing capacity and generalisation ability, making them inadequate for practical applications. While deep learning feature extraction modules have demonstrated remarkable performance in image and text processing, they remain ineffective when applied to multi-source heterogeneous industrial data lacking explicit correlations. Moreover, existing multi-source heterogeneous data processing techniques still rely on dimensionality reduction and feature selection, which can lead to information loss and difficulty in capturing high-order interactions. To address these challenges, this study applies the EAPCR and Time-EAPCR models proposed in previous research and introduces a new model, Time-EAPCR-T, where Transformer replaces the LSTM module in the time-series processing component of Time-EAPCR. This modification effectively addresses multi-source data heterogeneity, facilitates efficient multi-source feature fusion, and enhances the temporal feature extraction capabilities of multi-source industrial data.Experimental results demonstrate that the proposed method outperforms existing approaches across four industrial datasets, highlighting its broad application potential.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。