针对工业模型因数据漂移失效问题,提出三种迁移学习更新策略并对比效果。
From drift to adaptation to the failed ml model: Transfer Learning in Industrial MLOps
- 比较三种迁移学习方法:全层、最后一层和集成式,用于更新失效的神经网络模型。
- 5天批次下集成迁移学习预测准确率最高,8天批次下全层迁移学习更优。
- 不同批次大小下计算开销差异大,适合不同规模工业场景的模型更新。
模型在生产环境中适应数据漂移是可靠机器学习运维(MLOps)的关键,但现有研究较少关注模型失效后的系统性更新框架。本文对比了三种迁移学习驱动的模型更新策略:集成迁移学习(ETL)、全层迁移学习(ALTL)与最后一层迁移学习(LLTL),用于更新失效的前馈人工神经网络(ANN)模型。以660 MW燃煤电厂空气预热器烟气差压数据为案例,因其负荷周期性变化呈现批次过程特征。实验表明,在5天批次下,ETL提供更高预测精度;而在8天批次下,ALTL更有效。不同批次大小下,模型更新的计算需求(超参数调优与训练时间)呈混合趋势。该基于批次过程的工业实证研究为MLOps从业者应对模型失效与数据漂移提供了实用参考。
原文摘要 · Abstract (English)
Model adaptation to production environment is critical for reliable Machine Learning Operations (MLOps), less attention is paid to developing systematic framework for updating the ML models when they fail under data drift. This paper compares the transfer learning enabled model update strategies including ensemble transfer learning (ETL), all-layers transfer learning (ALTL), and last-layer transfer learning (LLTL) for updating the failed feedforward artificial neural network (ANN) model. The flue gas differential pressure across the air preheater unit installed in a 660 MW thermal power plant is analyzed as a case study since it mimics the batch processes due to load cycling in the power plant. Updating the failed ANN model by three transfer learning techniques reveals that ETL provides relatively higher predictive accuracy for the batch size of 5 days than those of LLTL and ALTL. However, ALTL is found to be suitable for effective update of the model trained on large batch size (8 days). A mixed trend is observed for computational requirement (hyperparameter tuning and model training) of model update techniques for different batch sizes. These fundamental and empiric insights obtained from the batch process-based industrial case study can assist the MLOps practitioners in adapting the failed models to data drifts for the accurate monitoring of industrial processes.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。