用大模型+多模态检索增强生成,让工业故障监控更准更可解释。
Agent-based Condition Monitoring Assistance with Multimodal Industrial Database Retrieval Augmented Generation
- 构建面向工业故障数据的多模态向量库,支持大模型推理
- 通过维修记录等替代标签训练模型,解决真实数据无标注难题
- 生成可解释的决策建议,适合工业运维人员快速响应
故障监测(CM)在流程工业中对保障可靠性和效率至关重要。尽管计算机化维护系统能有效检测和分类故障,但故障严重性评估和维护决策仍高度依赖人工专家分析。现有系统自动处理常伴随较高不确定性与误报率,增加工作负担并降低效率。本文提出MindRAG框架,将大语言模型(LLM)驱动的推理代理与CM工作流融合,旨在减少误报、提升故障严重性评估精度、改善决策支持,并提供可解释界面。该框架结合多模态检索增强生成(RAG)与专为工业数据设计的新颖向量存储结构,利用现有标注和维修工单作为监督学习中的替代标签,应对真实世界数据缺乏标注且噪声大的挑战。主要贡献包括:(1)构建适配于大模型工作流的半结构化多模态向量存储;(2)开发面向工业数据的多模态RAG技术;(3)实现可处理实际工业问题的推理代理;(4)建立用于在真实工业场景中集成与评估此类代理的实验框架。初步结果经资深分析师验证表明,MindRAG能提供有意义的决策支持,有助于更高效管理报警,提升故障监测系统的可解释性。
原文摘要 · Abstract (English)
Condition monitoring (CM) plays a crucial role in ensuring reliability and efficiency in the process industry. Although computerised maintenance systems effectively detect and classify faults, tasks like fault severity estimation, and maintenance decisions still largely depend on human expert analysis. The analysis and decision making automatically performed by current systems typically exhibit considerable uncertainty and high false alarm rates, leading to increased workload and reduced efficiency. This work integrates large language model (LLM)-based reasoning agents with CM workflows to address analyst and industry needs, namely reducing false alarms, enhancing fault severity estimation, improving decision support, and offering explainable interfaces. We propose MindRAG, a modular framework combining multimodal retrieval-augmented generation (RAG) with novel vector store structures designed specifically for CM data. The framework leverages existing annotations and maintenance work orders as surrogates for labels in a supervised learning protocol, addressing the common challenge of training predictive models on unlabelled and noisy real-world datasets. The primary contributions include: (1) an approach for structuring industry CM data into a semi-structured multimodal vector store compatible with LLM-driven workflows; (2) developing multimodal RAG techniques tailored for CM data; (3) developing practical reasoning agents capable of addressing real-world CM queries; and (4) presenting an experimental framework for integrating and evaluating such agents in realistic industrial scenarios. Preliminary results, evaluated with the help of an experienced analyst, indicate that MindRAG provide meaningful decision support for more efficient management of alarms, thereby improving the interpretability of CM systems.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。