arXiv:2607.03585cs.LG2026-07

用模块化基础模型提升工业数字孪生的时间序列感知能力

Modular Foundation Models for Time-Series Perception in Digital Twins

论文配图:Modular Foundation Models for Time-Series Perception in Digital Twins
图 1 · 摘自论文原文
  • 构建可复用的预训练编码器模块,通过自监督学习提取通用表征
  • 动态选择编码器并融合多源特征,在多个任务上表现优于基线
  • 适合工业健康监测、设备故障预测等需要少样本适应的场景

工程数字孪生与剩余寿命预测及健康管理(PHM)系统依赖于从异构且非平稳时间序列中提取可操作信息的鲁棒感知模块。然而,现有方法大多任务特定、数据需求高,难以集成到可扩展的监控与决策流程中。纯数据驱动模型在不同工况下常缺乏鲁棒性与泛化能力。本文提出一种基于预训练表征编码器集合的模块化时间序列基础模型。该框架利用异构数据集上的自监督学习,获取可迁移、任务无关的表征,支持跨任务复用。引入门控机制,根据目标数据集动态选择相关编码器,实现条件计算与自适应模型组合。选中的表征被投影至共享潜空间,并通过基于Transformer的自注意力模块聚合,显式建模编码器间交互。该架构通过轻量级任务头支持多种下游任务,包括补全、长期预测和少样本学习,且适配时冻结预训练编码器。消融实验验证了自监督预训练、编码器选择、表征对齐与自适应聚合的互补作用。在ETT基准测试中表现优异,真实工业案例(水轮机转子温度虚拟传感)进一步证明其实际价值。

原文摘要 · Abstract (English)

Engineering Digital Twins and Prognostics and Health Management (PHM) systems rely on robust perception modules to extract actionable information from heterogeneous and non-stationary time-series data. However, most existing approaches remain task-specific, data-hungry, and difficult to integrate into scalable monitoring and decision-making pipelines. Moreover, purely data-driven models often lack robustness and transferability across varying operating conditions. To address these challenges, this paper proposes a modular foundation model for time-series perception based on a collection of pretrained representation encoders. The framework leverages self-supervised learning on heterogeneous datasets to learn transferable and task-agnostic representations, which can be reused across multiple PHM tasks. A gating mechanism is introduced to dynamically select relevant encoders for a given target dataset, enabling conditional computation and adaptive model composition. The selected representations are projected into a shared latent space and aggregated using a Transformer-based self-attention module that explicitly models cross-encoder interactions. The resulting architecture supports multiple downstream tasks, including imputation, long-term forecasting, and few-shot learning, through lightweight task-specific heads, while keeping pretrained encoders frozen during adaptation. Extensive ablation studies demonstrate the complementary roles of self-supervised pretraining, encoder selection, representation alignment, and adaptive aggregation. Experimental results on the ETT benchmark show competitive performance across tasks, while a real-world industrial case study on virtual sensing for hydro-generator rotor temperature highlights the practical relevance of the approach.

时间序列数字孪生基础模型自监督学习

Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。