arXiv:2604.14766eess.SPcs.AI2026-04

用跨模态知识蒸馏,让小模型学会大模型的故障检测能力。

Temporal Cross-Modal Knowledge-Distillation-Based Transfer-Learning for Gas Turbine Vibration Fault Detection

  • 用大模型从长时序数据中提炼特征,教小模型识别振动异常。
  • 在工业数据上测试,诊断准确率显著优于传统方法。
  • 适合部署在算力有限的工厂设备上做实时故障预警。

防止机器故障远胜于事后修复,尤其对燃气轮机这类关键设备,早期故障检测(FD)是工业可持续性的核心。然而,现有深度学习模型常在模型复杂度与实时性之间权衡困难,且受限于短时振动信号窗口,缺乏时间上下文信息。为此,本文提出一种基于时序跨模态知识蒸馏的迁移学习框架(TCMKDTL)。该框架利用在长时序窗口(含前后上下文)训练的“优势”教师模型,将隐含特征知识蒸馏至轻量学生模型。为缓解数据稀缺与领域偏移问题,先在基准数据集(如CWRU)上进行鲁棒预训练,再适配到目标工业数据。基于实验与工业燃气轮机(MGT-40)数据集的大量评估表明,TCMKDTL相比传统预训练架构具有更优的特征可分性与诊断准确率。最终,该方法实现了高性能、无需标签的异常检测,适用于资源受限的工业硬件部署。

原文摘要 · Abstract (English)

Preventing machine failure is inherently superior to reactive remediation, particularly for critical assets like gas turbines, where early fault detection (FD) is a cornerstone of industrial sustainability. However, modern deep learning-based FD models often face a significant trade-off between architectural complexity and real-time operational constraints, often hindered by a lack of temporal context within restricted vibration signal windows. To address these challenges, this study proposes a Temporal Cross-Modal Knowledge-Distillation Transfer-Learning (TCMKDTL) framework. The framework employs a "privileged" teacher model trained on expansive temporal windows incorporating both past and future signal context to distill latent feature-based knowledge into a compact student model. To mitigate issues of data scarcity and domain shift, the framework leverages robust pre-training on benchmark datasets (such as CWRU) followed by adaptation to target industrial data. Extensive evaluation using experimental and industrial gas turbine (MGT-40) datasets demonstrates that TCMKDTL achieves superior feature separability and diagnostic accuracy compared to conventional pre-trained architectures. Ultimately, this approach enables high-performance, unsupervised anomaly detection suitable for deployment on resource-constrained industrial hardware.

故障检测知识蒸馏工业应用

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。