用轻量时序变换器+GRU,高效精准预测设备剩余寿命
FTT-GRU: A Hybrid Fast Temporal Transformer with GRU for Remaining Useful Life Prediction
- 结合快速傅里叶变换的轻量时序变换器与GRU,捕捉全局与局部退化特征
- 在CMAPSS FD001上达RMSE 30.76、MAE 18.97,延迟仅1.12毫秒
- 模型紧凑高效,适合工业场景实时故障预测
准确预测工业设备剩余使用寿命对减少停机时间和优化维护计划至关重要。现有方法如长短期记忆网络(LSTM)和卷积神经网络(CNN)难以同时建模多变量传感器数据中的全局时序依赖与细粒度退化趋势。本文提出混合模型FTT-GRU,融合基于快速傅里叶变换(FFT)线性化注意力的轻量级时序变换器(FTT)与门控循环单元(GRU)进行序列建模。据我们所知,这是首次将FTT与GRU结合用于CMAPSS数据集的剩余寿命预测,实现了在紧凑架构中同步捕捉全局与局部退化模式。在CMAPSS FD001上,FTT-GRU取得RMSE 30.76、MAE 18.97、$R^2=0.45$,批量为1时CPU延迟仅1.12毫秒。相比最优公开深度基线(TCN--Attention),RMSE降低1.16%,MAE降低4.00%。三次运行的训练曲线显示平滑收敛且95%置信区间窄,消融实验(仅GRU、仅FTT)验证了两组件的贡献。结果表明,该紧凑的Transformer-RNN混合模型可在CMAPSS上实现高精度且高效的剩余寿命预测,适用于实时工业预测场景。
原文摘要 · Abstract (English)
Accurate prediction of the remaining useful life (RUL) of industrial machinery is essential for reducing downtime and optimizing maintenance schedules. Existing approaches, such as long short-term memory (LSTM) networks and convolutional neural networks (CNNs), often struggle to model both global temporal dependencies and fine-grained degradation trends in multivariate sensor data. We propose a hybrid model, FTT-GRU, which combines a Fast Temporal Transformer (FTT) -- a lightweight Transformer variant using linearized attention via fast Fourier transform (FFT) -- with a gated recurrent unit (GRU) layer for sequential modeling. To the best of our knowledge, this is the first application of an FTT with a GRU for RUL prediction on NASA CMAPSS, enabling simultaneous capture of global and local degradation patterns in a compact architecture. On CMAPSS FD001, FTT-GRU attains RMSE 30.76, MAE 18.97, and $R^2=0.45$, with 1.12 ms CPU latency at batch=1. Relative to the best published deep baseline (TCN--Attention), it improves RMSE by 1.16\% and MAE by 4.00\%. Training curves averaged over $k=3$ runs show smooth convergence with narrow 95\% confidence bands, and ablations (GRU-only, FTT-only) support the contribution of both components. These results demonstrate that a compact Transformer-RNN hybrid delivers accurate and efficient RUL predictions on CMAPSS, making it suitable for real-time industrial prognostics.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。