为工业物联网预测模型设计了真实场景下的鲁棒性评测框架
Quantifying Robustness: A Benchmarking Framework for Deep Learning Forecasting in Cyber-Physical Systems
- 基于分布鲁棒性定义,模拟传感器漂移等实际干扰
- 在真实工业数据集上验证多种深度学习模型性能差异
- 提供可复现的评测基准,助力模型选型与架构优化
制造与能源分配等领域的网络物理系统(CPS)生成复杂的时间序列数据,对故障预测与健康管理(PHM)至关重要。尽管深度学习(DL)在预测方面表现优异,但其在工业CPS中的应用受限于鲁棒性不足。现有评估方法多关注形式化验证或对抗扰动,无法反映真实场景复杂性。为此,本文提出一种面向工业CPS的分布鲁棒性定义,并构建系统化评测框架,通过模拟传感器漂移、噪声及不规则采样等真实干扰,全面评估预测模型的鲁棒性。该框架提供标准化得分,支持跨数据集的模型性能量化比较,辅助模型选择与架构设计。基于多个主流DL架构(包括循环、卷积、注意力、模块化及结构化状态空间模型)的广泛实证研究,验证了方法的有效性。相关评测基准已公开,以促进后续研究与复现。
原文摘要 · Abstract (English)
Cyber-Physical Systems (CPS) in domains such as manufacturing and energy distribution generate complex time series data crucial for Prognostics and Health Management (PHM). While Deep Learning (DL) methods have demonstrated strong forecasting capabilities, their adoption in industrial CPS remains limited due insufficient robustness. Existing robustness evaluations primarily focus on formal verification or adversarial perturbations, inadequately representing the complexities encountered in real-world CPS scenarios. To address this, we introduce a practical robustness definition grounded in distributional robustness, explicitly tailored to industrial CPS, and propose a systematic framework for robustness evaluation. Our framework simulates realistic disturbances, such as sensor drift, noise and irregular sampling, enabling thorough robustness analyses of forecasting models on real-world CPS datasets. The robustness definition provides a standardized score to quantify and compare model performance across diverse datasets, assisting in informed model selection and architecture design. Through extensive empirical studies evaluating prominent DL architectures (including recurrent, convolutional, attention-based, modular, and structured state-space models) we demonstrate the applicability and effectiveness of our approach. We publicly release our robustness benchmark to encourage further research and reproducibility.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。