用大模型零样本构建可解释、带不确定性的工业软传感器
A Soft Sensor Method with Uncertainty-Awareness and Self-Explanation Based on Large Language Models Enhanced by Domain Knowledge Retrieval
- 用大模型上下文学习替代传统训练,零样本选变量
- 预测精度达最优,对噪声和数据变化更鲁棒
- 自动生成解释并量化不确定性,适合工业可信系统
数据驱动的软传感器在工业系统关键性能指标预测中至关重要。现有方法多依赖需大量标注数据的监督学习,存在开发成本高、鲁棒性差、训练不稳定和不可解释等问题。本文提出基于大语言模型(LLM)与领域知识检索的少样本不确定性感知与自解释软传感器框架(LLM-FUESS),包含零样本辅助变量选择模块(LLM-ZAVS)和不确定性感知少样本预测模块(LLM-UFSS)。LLM-ZAVS从工业知识向量库中检索领域知识,实现零样本变量选择;LLM-UFSS通过结构化数据的文本化上下文示例,引导大模型执行上下文学习(ICL)进行预测,并引入上下文样本检索增强策略提升性能。同时,利用大模型生成与概率特性,实现自解释与不确定性量化,构建可信软传感器。大量实验表明,该方法达到当前最优预测性能,具备强鲁棒性与灵活性,有效缓解传统方法的训练不稳定性。据我们所知,这是首个基于大模型构建软传感器的工作。
原文摘要 · Abstract (English)
Data-driven soft sensors are crucial in predicting key performance indicators in industrial systems. However, current methods predominantly rely on the supervised learning paradigms of parameter updating, which inherently faces challenges such as high development costs, poor robustness, training instability, and lack of interpretability. Recently, large language models (LLMs) have demonstrated significant potential across various domains, notably through In-Context Learning (ICL), which enables high-performance task execution with minimal input-label demonstrations and no prior training. This paper aims to replace supervised learning with the emerging ICL paradigm for soft sensor modeling to address existing challenges and explore new avenues for advancement. To achieve this, we propose a novel framework called the Few-shot Uncertainty-aware and self-Explaining Soft Sensor (LLM-FUESS), which includes the Zero-shot Auxiliary Variable Selector (LLM-ZAVS) and the Uncertainty-aware Few-shot Soft Sensor (LLM-UFSS). The LLM-ZAVS retrieves from the Industrial Knowledge Vector Storage to enhance LLMs' domain-specific knowledge, enabling zero-shot auxiliary variable selection. In the LLM-UFSS, we utilize text-based context demonstrations of structured data to prompt LLMs to execute ICL for predicting and propose a context sample retrieval augmentation strategy to improve performance. Additionally, we explored LLMs' AIGC and probabilistic characteristics to propose self-explanation and uncertainty quantification methods for constructing a trustworthy soft sensor. Extensive experiments demonstrate that our method achieved state-of-the-art predictive performance, strong robustness, and flexibility, effectively mitigates training instability found in traditional methods. To the best of our knowledge, this is the first work to establish soft sensor utilizing LLMs.
Thank you to arXiv for use of its open access interoperability. PaperDance 不是 arXiv 官方产品;中文卡片由大模型生成,请以原文为准。