arXiv:2603.23076cs.LG2026-03

针对工业设备预测性维护,提出轻量级多尺度Transformer模型。

MsFormer: Enabling Robust Predictive Maintenance Services for Industrial Devices

  • 设计多尺度采样与位置编码,捕捉多源传感器时序依赖。
  • 在小样本环境下仍保持高精度,优于现有先进方法。
  • 适合部署于数据稀缺的工业真实场景,服务可靠性强。

提供可靠的预测性维护是保障制造设备高可用性的关键工业AI服务。现有深度学习方法虽表现良好,但缺乏通用的服务化框架来捕捉工业物联网传感器数据中的复杂依赖关系。尽管基于Transformer的模型具备强大的序列建模能力,但其直接作为鲁棒AI服务部署面临显著瓶颈:实际服务环境中采集的流式传感器数据常表现出由设备工作原理驱动的多尺度时序相关性;同时,用于训练故障预测服务的数据集通常规模有限。为应对这些挑战,我们提出MsFormer——一种专为可靠工业预测性维护设计的轻量级多尺度Transformer。MsFormer引入多尺度采样(MS)模块和定制化位置编码机制,以捕捉跨多源流式数据的序列相关性。此外,为适应数据稀缺的服务环境,采用轻量级注意力机制结合简单池化操作,替代自注意力。在真实数据集上的大量实验表明,所提框架在性能上显著优于当前最先进方法。更重要的是,MsFormer在多种工业设备和运行条件下均表现优异,展现出强泛化能力,同时保持高可靠服务质量(QoS)。

原文摘要 · Abstract (English)

Providing reliable predictive maintenance is a critical industrial AI service essential for ensuring the high availability of manufacturing devices. Existing deep-learning methods present competitive results on such tasks but lack a general service-oriented framework to capture complex dependencies in industrial IoT sensor data. While Transformer-based models show strong sequence modeling capabilities, their direct deployment as robust AI services faces significant bottlenecks. Specifically, streaming sensor data collected in real-world service environments often exhibits multi-scale temporal correlations driven by machine working principles. Besides, the datasets available for training time-to-failure predictive services are typically limited in size. These issues pose significant challenges for directly applying existing models as robust predictive services. To address these challenges, we propose MsFormer, a lightweight Multi-scale Transformer designed as a unified AI service model for reliable industrial predictive maintenance. MsFormer incorporates a Multi-scale Sampling (MS) module and a tailored position encoding mechanism to capture sequential correlations across multi-streaming service data. Additionally, to accommodate data-scarce service environments, MsFormer adopts a lightweight attention mechanism with straightforward pooling operations instead of self-attention. Extensive experiments on real-world datasets demonstrate that the proposed framework achieves significant performance improvements over state-of-the-art methods. Furthermore, MsFormer outperforms across industrial devices and operating conditions, demonstrating strong generalizability while maintaining a highly reliable Quality of Service (QoS).

预测性维护工业AITransformer轻量化

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。