用大模型处理多维工业信号,提升设备剩余寿命预测精度与泛化能力。
Remaining Useful Life Prediction: A Study on Multidimensional Industrial Signal Processing and Efficient Transfer Learning Based on Large Language Models
- 基于大语言模型捕捉复杂时序依赖,统一滑动窗口处理所有数据集。
- 在FD002/FD004上超越现有最优方法,其他子集接近最优表现。
- 少量微调数据即可超越全量训练的SOTA模型,适合数据稀缺场景。
剩余使用寿命(RUL)预测对现代工业系统的可靠性与安全运行至关重要。传统方法依赖小规模深度学习或物理/统计模型,难以应对复杂的多维传感器数据和工况变化,泛化能力受限。为此,本文提出一种基于大语言模型(LLM)的回归框架,利用预训练语言模型在语料库上的建模能力,有效捕捉复杂时序依赖,提升预测精度。在涡轮发动机RUL预测任务上的大量实验表明,该模型在具有挑战性的FD002和FD004子集上超越当前最优(SOTA)方法,并在其余子集上达到近SOTA水平。值得注意的是,与以往研究不同,本框架对所有子集采用相同的滑动窗口长度和全部传感器信号,展现出强一致性和泛化能力。此外,迁移学习实验显示,仅需极少目标域数据微调,模型性能即优于在完整目标域数据上训练的SOTA方法。本研究揭示了大语言模型在工业信号处理与RUL预测中的巨大潜力,为未来智能工业系统健康管理提供前瞻性解决方案。
原文摘要 · Abstract (English)
Remaining useful life (RUL) prediction is crucial for maintaining modern industrial systems, where equipment reliability and operational safety are paramount. Traditional methods, based on small-scale deep learning or physical/statistical models, often struggle with complex, multidimensional sensor data and varying operating conditions, limiting their generalization capabilities. To address these challenges, this paper introduces an innovative regression framework utilizing large language models (LLMs) for RUL prediction. By leveraging the modeling power of LLMs pre-trained on corpus data, the proposed model can effectively capture complex temporal dependencies and improve prediction accuracy. Extensive experiments on the Turbofan engine's RUL prediction task show that the proposed model surpasses state-of-the-art (SOTA) methods on the challenging FD002 and FD004 subsets and achieves near-SOTA results on the other subsets. Notably, different from previous research, our framework uses the same sliding window length and all sensor signals for all subsets, demonstrating strong consistency and generalization. Moreover, transfer learning experiments reveal that with minimal target domain data for fine-tuning, the model outperforms SOTA methods trained on full target domain data. This research highlights the significant potential of LLMs in industrial signal processing and RUL prediction, offering a forward-looking solution for health management in future intelligent industrial systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。