用注意力模型预测维修时长,提升车队维修效率
Predictive Repair Management Using a Multi-Head Attention Transformer and Online Learning
- 基于多头注意力的表格数据模型,融合车辆标识与维修类型特征
- 在真实数据上达到78%准确率,优于传统神经网络与随机森林
- 支持在线学习,持续适应维修模式变化,适合运维场景
准确预测维修时长是产品维护中的关键挑战,直接影响资源分配、客户满意度和运营表现。本研究构建了一个端到端深度学习框架,利用汽车维修维护数据集,通过专为表格数据设计的多头注意力网络,将类别信息(经嵌入和注意力机制转换)与数值型历史数据结合,实现多源特征的融合学习。针对大数据集中的类别不平衡问题,引入加权损失函数;同时采用在线学习策略,实现模型的持续增量更新,以适应动态运行环境。实证结果表明,该模型在2013至2020年的实际维修数据上达到78%的预测准确率,且注意力权重分析揭示了车辆标识与维修类型间的有效交互关系。相比前馈神经网络和随机森林,其性能更优,并能实时响应新数据模式变化。
原文摘要 · Abstract (English)
Accurate prediction of repair duration is an important challenge in product maintenance due to its implications for resource allocation, customer satisfaction, and operational performance. This study aims to develop a deep learning framework to help fleet repair shops accurately categorize repair time given product historical data. The study uses an automobile repair and maintenance dataset and creates an end-to-end predictive framework by employing a multi-head attention network designed for tabular data. The developed framework combines categorical information, transformed through embeddings and attention mechanisms, with numerical historical data to facilitate integration and learning from diverse data features. A weighted loss function is introduced to overcome class imbalance issues in large datasets. Moreover, an online learning strategy is used for continuous incremental model updates to maintain predictive accuracy in evolving operational environments. Our empirical findings demonstrate that the multi-head attention mechanism extracts meaningful interactions between vehicle identifiers and repair types compared to a feed-forward neural network and a random forest model. Also, combining historical maintenance data with an online learning strategy facilitates real-time adjustments to changing patterns and increases the model's predictive performance on new data. The model is tested on real-world repair data spanning 2013 to 2020 and achieves an accuracy of 78%, with attention weight analyses illustrating feature interactions.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。